Apr 13 09:35:51 devstack cinder-volume[72592]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 09:35:51 devstack cinder-volume[72592]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 09:35:51 devstack cinder-volume[72592]: we strongly recommend against using it for new projects. Apr 13 09:35:51 devstack cinder-volume[72592]: If you are already using Eventlet, we recommend migrating to a different Apr 13 09:35:51 devstack cinder-volume[72592]: framework. For more detail see Apr 13 09:35:51 devstack cinder-volume[72592]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 09:35:51 devstack cinder-volume[72592]: import eventlet # noqa Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:35:53 devstack cinder-volume[72592]: INFO dbcounter [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Registered counter for database cinder Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG dbcounter [-] [72592] Writer thread running {{(pid=72592) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 09:35:53 devstack cinder-volume[72592]: INFO cinder.rpc [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 09:35:53 devstack cinder-volume[72592]: INFO cinder.rpc [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:35:53 devstack cinder-volume[72592]: INFO cinder.volume.manager [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Determined volume DB was empty at startup. Apr 13 09:35:53 devstack cinder-volume[72592]: DEBUG cinder.volume.manager [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72592) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 09:35:53 devstack cinder-volume[72592]: INFO cinder.volume.manager [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 09:35:53 devstack cinder-volume[72592]: WARNING stevedore.named [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 09:35:53 devstack cinder-volume[72592]: WARNING castellan.key_manager [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:35:53 devstack cinder-volume[72592]: WARNING cinder.keymgr.conf_key_mgr [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG cinder.volume.drivers.lvm [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72592) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_concurrency.processutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_concurrency.processutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.238s {{(pid=72592) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:35:54 devstack cinder-volume[72592]: INFO cinder.rpc [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 13 09:35:54 devstack cinder-volume[72592]: INFO cinder.rpc [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 13 09:35:54 devstack cinder-volume[72592]: WARNING stevedore.named [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 09:35:54 devstack cinder-volume[72592]: WARNING castellan.key_manager [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:35:54 devstack cinder-volume[72592]: INFO cinder.volume.manager [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72592) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:35:54 devstack cinder-volume[72592]: INFO oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Starting 1 workers Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Started child 72696 {{(pid=72592) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Full set of CONF: {{(pid=72592) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] ******************************************************************************** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Configuration options gathered from: {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 09:35:54 devstack cinder-volume[72696]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] ================================================================================ {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] allow_availability_zone_fallback = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] allow_compression_on_image_upload = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] allowed_direct_url_schemes = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] api_rate_limit = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] auth_strategy = keystone {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] az_cache_duration = 3600 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_availability_zone = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_host = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_stats_polling_interval = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backup_api_class = cinder.backup.api.API {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backup_name_template = backup-%s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backup_use_same_host = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backup_use_temp_snapshot = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] chap_password = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] chap_username = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_internal_tenant_project_id = d97c7fc0151c48d4b3edd676ae0e20c6 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_internal_tenant_user_id = 16a3b391e1f24b6b9c5c6a8b370ce46b {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cloned_volume_same_az = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cluster = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] compression_format = gzip {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] config_dir = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] config_source = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] control_exchange = openstack {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] debug = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] default_availability_zone = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] default_group_type = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] default_volume_type = lvmdriver-1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] disk_geometry = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] driver_client_cert = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] driver_client_cert_key = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] driver_data_namespace = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] driver_ssl_cert_path = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] driver_ssl_cert_verify = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] driver_use_ssl = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] enable_force_upload = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] enable_new_services = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] enable_unsupported_driver = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] enforce_multipath_for_image_xfer = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] filter_function = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_api_insecure = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_api_ssl_compression = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_ca_certificates_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_num_retries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance_request_timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] goodness_function = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] graceful_shutdown_timeout = 5 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] group_api_class = cinder.group.api.API {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] host = devstack {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_compress_on_upload = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_conversion_address_space_limit = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_conversion_cpu_limit = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_conversion_disable = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_upload_use_cinder_backend = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_upload_use_internal_tenant = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_volume_cache_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_volume_cache_max_count = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] init_host_max_objects_retrieval = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] instance_format = [instance: %(uuid)s] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] iscsi_target_flags = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] iscsi_write_cache = on {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] iser_helper = tgtadm {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] iser_ip_address = 192.168.122.58 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] iser_port = 3260 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_color = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_config_append = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72696]: INFO cinder.volume.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_dir = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_options = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_rotate_interval = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_rotate_interval_type = days {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] log_rotation_type = none {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] max_age = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] max_logfile_count = 30 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] max_logfile_size_mb = 200 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] max_over_subscription_ratio = 20.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] message_reap_interval = 86400 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] message_ttl = 2592000 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] monkey_patch = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] monkey_patch_modules = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] my_ip = 192.168.122.58 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] no_snapshot_gb_quota = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] num_iser_scan_tries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] num_shell_tries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] num_volume_device_scan_tries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] nvmeof_conn_info_version = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] nvmet_ns_id = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] nvmet_port_id = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_max_limit = 1000 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_volume_ext_list = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_volume_listen_port = 8776 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_volume_use_ssl = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] osapi_volume_workers = 2 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] per_volume_size_limit = -1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] periodic_fuzzy_delay = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] periodic_interval = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] public_endpoint = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] publish_errors = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_backup_gigabytes = 1000 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_backups = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_gigabytes = 1000 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_groups = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_snapshots = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] quota_volumes = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] rate_limit_burst = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] rate_limit_except_level = CRITICAL {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] rate_limit_interval = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] reinit_driver_count = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] replication_device = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] report_discard_supported = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] report_interval = 120 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] reservation_clean_interval = 86400 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] reservation_expire = 86400 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] reserved_image_namespaces = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] reserved_percentage = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] rpc_response_timeout = 120 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] run_external_periodic_tasks = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] scst_target_driver = iscsi {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] scst_target_iqn_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_down_time = 720 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] shell_completion = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] snapshot_name_template = snapshot-%s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] snapshot_same_host = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] split_loggers = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] state_path = /opt/stack/data/cinder {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] storage_availability_zone = nova {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] storage_protocol = iSCSI {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] syslog_log_facility = LOG_USER {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] target_helper = lioadm {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] target_ip_address = 192.168.122.58 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] target_port = 3260 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] target_protocol = iscsi {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] target_secondary_ip_addresses = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] trace_flags = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] transport_url = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] until_refresh = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_chap_auth = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_default_quota_class = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_journal = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_json = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_multipath_for_image_xfer = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_stderr = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] use_syslog = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] verify_glance_signatures = enabled {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_api_class = cinder.volume.api.API {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_backend_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_clear = zero {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_clear_ionice = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_clear_size = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_copy_bps_limit = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_dd_blocksize = 1M {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_name_template = volume-%s {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_service_inithost_offload = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volume_usage_audit_period = month {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] zoning_mode = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.admin_password = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.admin_token = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.admin_user = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_port = 35357 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_protocol = https {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_section = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_type = password {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_uri = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.auth_version = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.cache = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.identity_uri = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.insecure = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.interface = public {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_password = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcache_username = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.region_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.service_type = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.backend = dogpile.cache.null {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.backend_argument = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.backend_expiration_time = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.config_prefix = cache.oslo {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.debug_cache_backend = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.enable_retry_client = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.enable_socket_keepalive = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.enforce_fips_mode = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.expiration_time = 600 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_dead_retry = 300 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_sasl_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.password = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.proxies = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.redis_db = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.redis_server = localhost:6379 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.retry_attempts = 2 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.retry_delay = 0.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.socket_keepalive_count = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.socket_keepalive_idle = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.socket_keepalive_interval = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.socket_timeout = 1.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.tls_allowed_ciphers = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.tls_cafile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.tls_certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.tls_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.tls_keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cache.username = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] coordination.backend_url = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.asyncio_connection = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.asyncio_slave_connection = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.backend = sqlalchemy {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.connection = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.connection_debug = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.connection_parameters = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.connection_recycle_time = 3600 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.connection_trace = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.db_inc_retry_interval = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.db_max_retries = 20 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.db_max_retry_interval = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.db_retry_interval = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.max_overflow = 50 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.max_pool_size = 5 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.max_retries = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.pool_timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.retry_interval = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.slave_connection = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.sqlite_synchronous = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.synchronous_reader = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] database.use_db_reconnect = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.connection_string = messaging:// {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.es_doc_type = notification {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.es_scroll_size = 10000 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.es_scroll_time = 2m {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.filter_error_trace = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.hmac_keys = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.sentinel_service_name = mymaster {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.socket_timeout = 0.1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.trace_requests = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler.trace_sqlalchemy = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler_jaeger.process_tags = {} {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] profiler_otlp.service_name_prefix = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.enforce_new_defaults = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: WARNING oslo_config.cfg [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.enforce_scope = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.policy_default_rule = default {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.group = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.helper_command = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] privsep_osbrick.user = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.group = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.helper_command = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] cinder_sys_admin.user = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.auth_section = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.auth_type = password {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.cafile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.collect_timing = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.insecure = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.send_service_user_token = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.split_loggers = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] service_user.timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.auth_section = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.auth_type = password {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.collect_timing = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.insecure = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.region_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.split_loggers = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] glance.timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.backend_availability_zone = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.chap_password = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.chap_username = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.disk_geometry = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.driver_client_cert = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.driver_data_namespace = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.driver_use_ssl = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.extra_capabilities = {} {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.filter_function = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.goodness_function = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.iscsi_target_flags = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.iser_port = 3260 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.lvm_share_target = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.lvm_type = auto {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.replication_device = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.report_discard_supported = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.target_helper = tgtadm {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.target_port = 3260 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.target_protocol = iscsi {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.trace_flags = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.use_chap_auth = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_backend_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_clear = zero {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_reports.file_event_handler = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_reports.log_dir = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.backend_host = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.chap_password = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.chap_username = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.disk_geometry = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.driver_client_cert = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.extra_capabilities = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.filter_function = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.goodness_function = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.iser_helper = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.iser_ip_address = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.iser_port = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.lvm_share_target = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.lvm_type = auto {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.num_shell_tries = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.replication_device = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.report_discard_supported = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.reserved_percentage = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.scst_target_driver = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.storage_protocol = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.target_helper = lioadm {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.target_ip_address = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.target_port = 3260 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack sudo[72700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.trace_flags = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.use_chap_auth = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack sudo[72700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_clear = zero {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_clear_size = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] lvmdriver-1.volumes_dir = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_notifications.driver = [] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] key_manager.fixed_key = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.barbican_api_version = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.barbican_endpoint = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.barbican_endpoint_type = public {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.barbican_region_name = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.cafile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.collect_timing = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.insecure = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.number_of_retries = 60 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.retry_delay = 1 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.send_service_user_token = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.split_loggers = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.verify_ssl = True {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican.verify_ssl_path = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.auth_section = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.auth_type = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.cafile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.certfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.collect_timing = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.insecure = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.keyfile = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.split_loggers = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] barbican_service_user.timeout = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.approle_role_id = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.approle_secret_id = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.kv_mountpoint = secret {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.kv_path = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.kv_version = 2 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.namespace = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.root_token_id = **** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.ssl_ca_crt_file = None {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.timeout = 60.0 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.use_ssl = False {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:35:54 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] ******************************************************************************** {{(pid=72592) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 09:35:55 devstack sudo[72700]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:55 devstack sudo[72754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:35:55 devstack sudo[72754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:55 devstack sudo[72754]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.552s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:35:55 devstack cinder-volume[72696]: INFO cinder.brick.local_dev.lvm [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:55 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:55 devstack sudo[73015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:35:55 devstack sudo[73015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:56 devstack sudo[73015]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:56 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:56 devstack cinder-volume[72696]: DEBUG cinder.brick.local_dev.lvm [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72696) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 13 09:35:56 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:56 devstack sudo[73226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:35:56 devstack sudo[73226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:57 devstack sudo[73226]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.879s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:57 devstack sudo[73368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:35:57 devstack sudo[73368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:57 devstack sudo[73368]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:57 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:57 devstack sudo[73397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 13 09:35:57 devstack sudo[73397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:58 devstack sudo[73397]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:58 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.441s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:58 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:58 devstack sudo[73400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:35:58 devstack sudo[73400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:58 devstack sudo[73400]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:58 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:58 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:58 devstack sudo[73405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:35:58 devstack sudo[73405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:59 devstack sudo[73405]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:59 devstack sudo[73408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:35:59 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:59 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:59 devstack sudo[73416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:35:59 devstack sudo[73416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:35:59 devstack sudo[73416]: pam_unix(sudo:session): session closed for user root Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:35:59 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:35:59 devstack sudo[73422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:35:59 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:00 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:00 devstack cinder-volume[72696]: INFO cinder.volume.drivers.lvm [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:00 devstack sudo[73432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:36:00 devstack sudo[73432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:00 devstack sudo[73432]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG cinder.volume.drivers.lvm [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Updating volume stats {{(pid=72696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 09:36:00 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:00 devstack sudo[73544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:36:00 devstack sudo[73544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:01 devstack sudo[73544]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:01 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:01 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:01 devstack sudo[73551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:36:01 devstack sudo[73551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:01 devstack sudo[73551]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:01 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:01 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:01 devstack sudo[73688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:36:01 devstack sudo[73688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:02 devstack sudo[73688]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:02 devstack sudo[73692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:36:02 devstack sudo[73692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:02 devstack sudo[73692]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:02 devstack cinder-volume[72696]: INFO cinder.volume.driver [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG cinder.volume.driver [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72696) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG oslo_db.sqlalchemy.engines [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG dbcounter [-] [72696] Writer thread running {{(pid=72696) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG cinder.db.sqlalchemy.api [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Building query based on filter {{(pid=72696) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG cinder.image.image_utils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72696) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 09:36:02 devstack cinder-volume[72696]: INFO cinder.keymgr.migration [None req-68b80339-851a-4506-b314-c68798304d05 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG cinder.volume.drivers.lvm [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Updating volume stats {{(pid=72696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 09:36:02 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:02 devstack sudo[73697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:36:02 devstack sudo[73697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:03 devstack sudo[73697]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:03 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:03 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:03 devstack sudo[73703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:36:03 devstack sudo[73703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:03 devstack sudo[73703]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:03 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:03 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:03 devstack sudo[73706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:36:03 devstack sudo[73706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:04 devstack sudo[73706]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:04 devstack sudo[73712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:36:04 devstack sudo[73712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:04 devstack cinder-volume[72592]: DEBUG dbcounter [-] [72592] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72592) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:36:04 devstack sudo[73712]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG cinder.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Notifying Schedulers of capabilities ... {{(pid=72696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:36:04 devstack cinder-volume[72696]: INFO cinder.volume.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Driver initialization completed successfully. Apr 13 09:36:04 devstack cinder-volume[72696]: INFO cinder.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Initiating service 2 cleanup Apr 13 09:36:04 devstack cinder-volume[72696]: INFO cinder.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Service 2 cleanup completed. Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG cinder.service [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Creating RPC server for service cinder-volume {{(pid=72696) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG cinder.service [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72696) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 09:36:04 devstack cinder-volume[72696]: INFO cinder.volume.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG cinder.volume.drivers.lvm [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Updating volume stats {{(pid=72696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 09:36:04 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:04 devstack sudo[73719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:36:04 devstack sudo[73719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:05 devstack sudo[73719]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:05 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:05 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:05 devstack sudo[73725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:36:05 devstack sudo[73725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:05 devstack sudo[73725]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:05 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:05 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:05 devstack sudo[73739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:36:05 devstack sudo[73739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:06 devstack sudo[73739]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:06 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:06 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:36:06 devstack sudo[73786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:36:06 devstack sudo[73786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:36:06 devstack sudo[73786]: pam_unix(sudo:session): session closed for user root Apr 13 09:36:06 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:36:06 devstack cinder-volume[72696]: INFO cinder.volume.manager [None req-d7922d0b-d344-4bfa-b9b0-dc40a742c572 None None] Driver post RPC initialization completed successfully. Apr 13 09:36:14 devstack cinder-volume[72696]: DEBUG dbcounter [-] [72696] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72696) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:36:16 devstack cinder-volume[72696]: DEBUG dbcounter [-] [72696] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=72696) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:37:51 devstack cinder-volume[72696]: DEBUG oslo_service.periodic_task [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72696) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:37:51 devstack cinder-volume[72696]: DEBUG cinder.volume.drivers.lvm [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Updating volume stats {{(pid=72696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 09:37:51 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:37:51 devstack sudo[78854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:37:51 devstack sudo[78854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:37:52 devstack sudo[78854]: pam_unix(sudo:session): session closed for user root Apr 13 09:37:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:37:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:37:52 devstack sudo[78862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:37:52 devstack sudo[78862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:37:52 devstack sudo[78862]: pam_unix(sudo:session): session closed for user root Apr 13 09:37:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:37:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:37:52 devstack sudo[78873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:37:52 devstack sudo[78873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:37:53 devstack sudo[78873]: pam_unix(sudo:session): session closed for user root Apr 13 09:37:53 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:37:53 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:37:53 devstack sudo[78880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:37:53 devstack sudo[78880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:37:53 devstack sudo[78880]: pam_unix(sudo:session): session closed for user root Apr 13 09:37:53 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.407s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:37:53 devstack cinder-volume[72696]: DEBUG cinder.manager [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Notifying Schedulers of capabilities ... {{(pid=72696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:38:16 devstack cinder-volume[72696]: DEBUG dbcounter [-] [72696] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72696) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:38:51 devstack cinder-volume[72696]: DEBUG oslo_service.periodic_task [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72696) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:38:51 devstack cinder-volume[72696]: DEBUG cinder.volume.drivers.lvm [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Updating volume stats {{(pid=72696) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 09:38:51 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:38:51 devstack sudo[81101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 09:38:51 devstack sudo[81101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:38:52 devstack sudo[81101]: pam_unix(sudo:session): session closed for user root Apr 13 09:38:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:38:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:38:52 devstack sudo[81140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:38:52 devstack sudo[81140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:38:52 devstack sudo[81140]: pam_unix(sudo:session): session closed for user root Apr 13 09:38:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:38:52 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:38:52 devstack sudo[81148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 09:38:52 devstack sudo[81148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:38:53 devstack sudo[81148]: pam_unix(sudo:session): session closed for user root Apr 13 09:38:53 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:38:53 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:38:53 devstack sudo[81152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 09:38:53 devstack sudo[81152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:38:53 devstack sudo[81152]: pam_unix(sudo:session): session closed for user root Apr 13 09:38:53 devstack cinder-volume[72696]: DEBUG oslo_concurrency.processutils [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72696) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:38:53 devstack cinder-volume[72696]: DEBUG cinder.manager [None req-6f6fa1ef-2364-4b0d-a88c-40dbda53d653 None None] Notifying Schedulers of capabilities ... {{(pid=72696) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:39:16 devstack cinder-volume[72592]: INFO oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Caught SIGTERM, stopping children Apr 13 09:39:16 devstack cinder-volume[72592]: DEBUG oslo_concurrency.lockutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Acquiring lock "singleton_lock" {{(pid=72592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:39:16 devstack cinder-volume[72592]: DEBUG oslo_concurrency.lockutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Acquired lock "singleton_lock" {{(pid=72592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:39:16 devstack cinder-volume[72592]: DEBUG oslo_concurrency.lockutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Releasing lock "singleton_lock" {{(pid=72592) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:39:16 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Stop services. {{(pid=72592) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 09:39:16 devstack cinder-volume[72592]: DEBUG oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Killing children. {{(pid=72592) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 09:39:16 devstack cinder-volume[72592]: INFO oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Waiting on 1 children to exit Apr 13 09:39:19 devstack cinder-volume[72696]: DEBUG oslo_concurrency.lockutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Acquiring lock "singleton_lock" {{(pid=72696) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:39:19 devstack cinder-volume[72696]: DEBUG oslo_concurrency.lockutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Acquired lock "singleton_lock" {{(pid=72696) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:39:19 devstack cinder-volume[72696]: DEBUG oslo_concurrency.lockutils [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Releasing lock "singleton_lock" {{(pid=72696) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:39:19 devstack cinder-volume[72696]: WARNING amqp [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 09:39:19 devstack cinder-volume[72696]: WARNING amqp [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 09:39:19 devstack cinder-volume[72592]: INFO oslo_service.backend._eventlet.service [None req-0cb32a53-48fe-4629-837a-16e7549da9d3 None None] Child 72696 exited with status 0 Apr 13 09:39:20 devstack cinder-volume[81741]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 09:39:20 devstack cinder-volume[81741]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 09:39:20 devstack cinder-volume[81741]: we strongly recommend against using it for new projects. Apr 13 09:39:20 devstack cinder-volume[81741]: If you are already using Eventlet, we recommend migrating to a different Apr 13 09:39:20 devstack cinder-volume[81741]: framework. For more detail see Apr 13 09:39:20 devstack cinder-volume[81741]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 09:39:20 devstack cinder-volume[81741]: import eventlet # noqa Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:39:22 devstack cinder-volume[81741]: INFO dbcounter [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Registered counter for database cinder Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG oslo_db.sqlalchemy.engines [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG dbcounter [-] [81741] Writer thread running {{(pid=81741) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 09:39:22 devstack cinder-volume[81741]: INFO cinder.rpc [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 09:39:22 devstack cinder-volume[81741]: INFO cinder.rpc [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG oslo_db.sqlalchemy.engines [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:22 devstack cinder-volume[81741]: INFO cinder.volume.manager [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Determined volume DB was empty at startup. Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG cinder.volume.manager [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81741) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 09:39:22 devstack cinder-volume[81741]: INFO cinder.volume.manager [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 09:39:22 devstack cinder-volume[81741]: WARNING stevedore.named [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 09:39:22 devstack cinder-volume[81741]: WARNING castellan.key_manager [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:39:22 devstack cinder-volume[81741]: WARNING cinder.keymgr.conf_key_mgr [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:39:22 devstack cinder-volume[81741]: INFO cinder.volume.manager [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 09:39:22 devstack cinder-volume[81741]: DEBUG oslo_db.sqlalchemy.engines [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:23 devstack cinder-volume[81741]: INFO oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Starting 1 workers Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Started child 81858 {{(pid=81741) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Full set of CONF: {{(pid=81741) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] ******************************************************************************** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Configuration options gathered from: {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] ================================================================================ {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] allow_availability_zone_fallback = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] allow_compression_on_image_upload = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] allowed_direct_url_schemes = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] api_rate_limit = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] auth_strategy = keystone {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_availability_zone = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_host = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_stats_polling_interval = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backup_api_class = cinder.backup.api.API {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backup_name_template = backup-%s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backup_use_same_host = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backup_use_temp_snapshot = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] chap_password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] chap_username = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_internal_tenant_project_id = d97c7fc0151c48d4b3edd676ae0e20c6 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_internal_tenant_user_id = 16a3b391e1f24b6b9c5c6a8b370ce46b {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cluster = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] compression_format = gzip {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] compute_api_class = cinder.compute.nova.API {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] config_dir = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] config_source = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] control_exchange = openstack {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] debug = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] default_availability_zone = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] default_group_type = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81858]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] default_volume_type = QuobyteHD {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] disk_geometry = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] driver_client_cert = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] driver_client_cert_key = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] driver_data_namespace = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] driver_ssl_cert_path = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] driver_ssl_cert_verify = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] driver_use_ssl = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] enable_new_services = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] enable_unsupported_driver = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] enabled_backends = ['QuobyteHD'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] enforce_multipath_for_image_xfer = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] filter_function = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_api_insecure = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_api_ssl_compression = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_ca_certificates_file = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_catalog_info = image:glance:publicURL {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_num_retries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance_request_timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] goodness_function = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] graceful_shutdown_timeout = 5 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] group_api_class = cinder.group.api.API {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] host = devstack {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_compress_on_upload = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_conversion_address_space_limit = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_conversion_cpu_limit = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_conversion_disable = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_upload_use_cinder_backend = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_upload_use_internal_tenant = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_volume_cache_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_volume_cache_max_count = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] image_volume_cache_max_size_gb = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] init_host_max_objects_retrieval = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] instance_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] iscsi_target_flags = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] iscsi_write_cache = on {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] iser_helper = tgtadm {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] iser_ip_address = 192.168.122.58 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] iser_port = 3260 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_color = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_config_append = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_dir = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_file = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_options = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_rotate_interval = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_rotate_interval_type = days {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] log_rotation_type = none {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] max_age = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] max_logfile_count = 30 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] max_logfile_size_mb = 200 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] max_over_subscription_ratio = 20.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] message_reap_interval = 86400 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] message_ttl = 2592000 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] migration_create_volume_timeout_secs = 300 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] monkey_patch = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] monkey_patch_modules = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] my_ip = 192.168.122.58 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] no_snapshot_gb_quota = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] num_iser_scan_tries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] num_shell_tries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] num_volume_device_scan_tries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] nvmeof_conn_info_version = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] nvmet_ns_id = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] nvmet_port_id = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_max_limit = 1000 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_volume_ext_list = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_volume_listen = 0.0.0.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_volume_listen_port = 8776 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_volume_use_ssl = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] osapi_volume_workers = 2 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] per_volume_size_limit = -1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] periodic_fuzzy_delay = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] periodic_interval = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] project_id_regex = [0-9a-f\-]+ {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] public_endpoint = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] publish_errors = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_backup_gigabytes = 1000 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_backups = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_gigabytes = 1000 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_groups = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_snapshots = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] quota_volumes = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] rate_limit_burst = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] rate_limit_except_level = CRITICAL {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] rate_limit_interval = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] reinit_driver_count = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] replication_device = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] report_discard_supported = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] report_interval = 120 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] reservation_clean_interval = 86400 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] reservation_expire = 86400 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] reserved_image_namespaces = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] reserved_percentage = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] rpc_response_timeout = 120 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] run_external_periodic_tasks = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] scst_target_driver = iscsi {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] scst_target_iqn_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_down_time = 720 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] shell_completion = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] snapshot_name_template = snapshot-%s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] split_loggers = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] state_path = /opt/stack/data/cinder {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] storage_availability_zone = nova {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] storage_protocol = iSCSI {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] syslog_log_facility = LOG_USER {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] target_helper = lioadm {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] target_ip_address = 192.168.122.58 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] target_port = 3260 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] target_protocol = iscsi {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] target_secondary_ip_addresses = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] trace_flags = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] transfer_api_class = cinder.transfer.api.API {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] transport_url = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] until_refresh = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_chap_auth = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_default_quota_class = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_journal = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_json = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_multipath_for_image_xfer = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_stderr = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] use_syslog = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] verify_glance_signatures = enabled {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_api_class = cinder.volume.api.API {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_backend_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_clear = zero {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_clear_ionice = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_clear_size = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_copy_bps_limit = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_dd_blocksize = 1M {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_name_template = volume-%s {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_service_inithost_offload = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volume_usage_audit_period = month {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] zoning_mode = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_concurrency.disable_process_locking = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.admin_password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.admin_token = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.admin_user = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_admin_prefix = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_port = 35357 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_protocol = https {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_section = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_type = password {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_uri = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.auth_version = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.cache = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.identity_uri = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.include_service_catalog = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.insecure = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.interface = public {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_password = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcache_username = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.region_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.service_type = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.backend = dogpile.cache.null {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.backend_argument = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.backend_expiration_time = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.config_prefix = cache.oslo {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.debug_cache_backend = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.enable_retry_client = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.enable_socket_keepalive = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.enforce_fips_mode = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.expiration_time = 600 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.hashclient_retry_attempts = 2 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_dead_retry = 300 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_pool_maxsize = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_sasl_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.proxies = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.redis_db = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.redis_server = localhost:6379 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.retry_attempts = 2 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.retry_delay = 0.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.socket_keepalive_count = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.socket_keepalive_idle = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.socket_keepalive_interval = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.socket_timeout = 1.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.tls_allowed_ciphers = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.tls_cafile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.tls_certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.tls_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.tls_keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cache.username = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] coordination.backend_url = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.asyncio_connection = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.asyncio_slave_connection = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.backend = sqlalchemy {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.connection = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.connection_debug = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.connection_parameters = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.connection_recycle_time = 3600 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.connection_trace = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.db_inc_retry_interval = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.db_max_retries = 20 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.db_max_retry_interval = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.db_retry_interval = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.max_overflow = 50 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.max_pool_size = 5 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.max_retries = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.mysql_wsrep_sync_wait = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.pool_timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.retry_interval = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.slave_connection = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.sqlite_synchronous = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.synchronous_reader = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] database.use_db_reconnect = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.connection_string = messaging:// {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.es_doc_type = notification {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.es_scroll_size = 10000 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.es_scroll_time = 2m {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.filter_error_trace = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.hmac_keys = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.sentinel_service_name = mymaster {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.socket_timeout = 0.1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.trace_requests = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler.trace_sqlalchemy = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler_jaeger.process_tags = {} {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler_jaeger.service_name_prefix = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] profiler_otlp.service_name_prefix = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.enforce_new_defaults = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: WARNING oslo_config.cfg [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.enforce_scope = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.policy_default_rule = default {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.policy_file = policy.yaml {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_policy.remote_timeout = 60.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.group = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.helper_command = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] privsep_osbrick.user = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.group = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.helper_command = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] cinder_sys_admin.user = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.auth_section = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.auth_type = password {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.cafile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.collect_timing = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.insecure = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.send_service_user_token = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.split_loggers = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] service_user.timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.auth_section = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.auth_type = password {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.collect_timing = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.insecure = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.region_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.split_loggers = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] glance.timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.backend_availability_zone = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.chap_password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.chap_username = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.disk_geometry = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.driver_client_cert = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.driver_client_cert_key = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.driver_data_namespace = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.driver_use_ssl = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.extra_capabilities = {} {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.filter_function = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.goodness_function = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.iscsi_target_flags = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.iscsi_write_cache = on {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.iser_helper = tgtadm {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.iser_port = 3260 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_host = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_login = admin {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_mount_options = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_private_key = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_share_path = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_ssh_port = 22 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.num_shell_tries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.quobyte_volume_url = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.replication_device = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.report_discard_supported = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.reserved_percentage = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.target_helper = tgtadm {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.target_port = 3260 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.target_protocol = iscsi {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.trace_flags = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.unique_fqdn_network = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.use_chap_auth = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_backend_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_clear = zero {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_clear_ionice = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_clear_size = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_reports.file_event_handler = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_reports.log_dir = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.backend_availability_zone = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.backend_host = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.chap_password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.chap_username = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.chiscsi_conf = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.disk_geometry = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.driver_client_cert = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.driver_data_namespace = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.driver_use_ssl = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.extra_capabilities = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.filter_function = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.goodness_function = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.iscsi_target_flags = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.iscsi_write_cache = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.iser_helper = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.iser_ip_address = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.iser_port = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.iser_target_prefix = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_host = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_login = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_mount_options = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_password = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_private_key = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_share_path = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_ssh_port = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.num_shell_tries = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nvmet_ns_id = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.nvmet_port_id = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.replication_device = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.report_discard_supported = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.reserved_percentage = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.scst_target_driver = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.storage_protocol = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.target_helper = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.target_ip_address = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.target_port = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.target_prefix = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.target_protocol = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.trace_flags = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.unique_fqdn_network = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.use_chap_auth = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_clear = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_clear_ionice = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_clear_size = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] QuobyteHD.volumes_dir = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.ssl = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81858]: INFO cinder.volume.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.ssl_version = {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_notifications.driver = [] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_notifications.retry = -1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] key_manager.fixed_key = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.remotefs [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81858) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.barbican_api_version = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.barbican_endpoint = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.barbican_endpoint_type = public {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.barbican_region_name = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.cafile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.collect_timing = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.insecure = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.number_of_retries = 60 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.retry_delay = 1 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.send_service_user_token = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.split_loggers = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.verify_ssl = True {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican.verify_ssl_path = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.auth_section = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.auth_type = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.cafile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.certfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.collect_timing = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.insecure = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.keyfile = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.split_loggers = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] barbican_service_user.timeout = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.approle_role_id = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.approle_secret_id = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.kv_mountpoint = secret {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.kv_path = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.kv_version = 2 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.namespace = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.root_token_id = **** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.ssl_ca_crt_file = None {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.timeout = 60.0 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.use_ssl = False {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:23 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] ******************************************************************************** {{(pid=81741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81858) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 09:39:23 devstack cinder-volume[81858]: WARNING cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 09:39:23 devstack cinder-volume[81858]: WARNING cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Running cmd (subprocess): mount.quobyte {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:23 devstack quobyte-client[81859]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 09:39:23 devstack quobyte-client[81859]: Invalid parameters found, error: missing mount point. Apr 13 09:39:23 devstack quobyte-client[81859]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 09:39:23 devstack quobyte-client[81859]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=81858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:23 devstack cinder-volume[81858]: INFO cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 ... Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 -c /etc/quobyte/client-cinder.cfg {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:23 devstack sudo[81860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 -c /etc/quobyte/client-cinder.cfg Apr 13 09:39:23 devstack sudo[81860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:23 devstack sudo[81860]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.511s {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:23 devstack cinder-volume[81858]: INFO cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 succeeded Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=81858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.520s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:23 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:23 devstack sudo[81929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:23 devstack sudo[81929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:24 devstack sudo[81929]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.410s {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:24 devstack cinder-volume[81858]: INFO cinder.volume.driver [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.volume.driver [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81858) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_db.sqlalchemy.engines [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG dbcounter [-] [81858] Writer thread running {{(pid=81858) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.db.sqlalchemy.api [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Building query based on filter {{(pid=81858) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.image.image_utils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81858) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 09:39:24 devstack cinder-volume[81858]: INFO cinder.keymgr.migration [None req-a3bc72e3-e0ef-4734-8a22-8d1c1dd03682 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=81858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=81858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:24 devstack sudo[81934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:24 devstack sudo[81934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:24 devstack sudo[81934]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.394s {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Notifying Schedulers of capabilities ... {{(pid=81858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:39:24 devstack cinder-volume[81858]: INFO cinder.volume.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Driver initialization completed successfully. Apr 13 09:39:24 devstack cinder-volume[81858]: INFO cinder.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Initiating service 3 cleanup Apr 13 09:39:24 devstack cinder-volume[81858]: INFO cinder.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Service 3 cleanup completed. Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.service [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Creating RPC server for service cinder-volume {{(pid=81858) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.service [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81858) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 09:39:24 devstack cinder-volume[81858]: INFO cinder.volume.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=81858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=81858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:24 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:24 devstack sudo[81939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:24 devstack sudo[81939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:25 devstack sudo[81939]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:25 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.405s {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:25 devstack cinder-volume[81858]: INFO cinder.volume.manager [None req-bfe65daf-e524-4f46-9a3b-5ff3d4961209 None None] Driver post RPC initialization completed successfully. Apr 13 09:39:27 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:27 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:27 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=81858) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:27 devstack cinder-volume[81858]: DEBUG cinder.volume.drivers.quobyte [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=81858) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:27 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81858) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:27 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:28 devstack sudo[82005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:28 devstack sudo[82005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:28 devstack sudo[82005]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:28 devstack cinder-volume[81858]: DEBUG oslo_concurrency.processutils [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.372s {{(pid=81858) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:28 devstack cinder-volume[81858]: DEBUG cinder.manager [None req-bfcfb01e-e2e5-434e-b69d-9dbb18f4ec56 None None] Notifying Schedulers of capabilities ... {{(pid=81858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:39:32 devstack cinder-volume[81741]: INFO oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Caught SIGTERM, stopping children Apr 13 09:39:32 devstack cinder-volume[81741]: DEBUG oslo_concurrency.lockutils [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Acquiring lock "singleton_lock" {{(pid=81741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:39:32 devstack cinder-volume[81741]: DEBUG oslo_concurrency.lockutils [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Acquired lock "singleton_lock" {{(pid=81741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:39:32 devstack cinder-volume[81741]: DEBUG oslo_concurrency.lockutils [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Releasing lock "singleton_lock" {{(pid=81741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:39:32 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Stop services. {{(pid=81741) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 09:39:32 devstack cinder-volume[81741]: DEBUG oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Killing children. {{(pid=81741) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 09:39:32 devstack cinder-volume[81741]: INFO oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Waiting on 1 children to exit Apr 13 09:39:32 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Acquiring lock "singleton_lock" {{(pid=81858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:39:32 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Acquired lock "singleton_lock" {{(pid=81858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:39:32 devstack cinder-volume[81858]: DEBUG oslo_concurrency.lockutils [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Releasing lock "singleton_lock" {{(pid=81858) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:39:33 devstack cinder-volume[81858]: WARNING amqp [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 09:39:33 devstack cinder-volume[81858]: WARNING amqp [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 09:39:33 devstack cinder-volume[81741]: INFO oslo_service.backend._eventlet.service [None req-219f611d-d6c0-429b-89a0-154459b7b38b None None] Child 81858 exited with status 0 Apr 13 09:39:33 devstack cinder-volume[82080]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 09:39:33 devstack cinder-volume[82080]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 09:39:33 devstack cinder-volume[82080]: we strongly recommend against using it for new projects. Apr 13 09:39:33 devstack cinder-volume[82080]: If you are already using Eventlet, we recommend migrating to a different Apr 13 09:39:33 devstack cinder-volume[82080]: framework. For more detail see Apr 13 09:39:33 devstack cinder-volume[82080]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 09:39:33 devstack cinder-volume[82080]: import eventlet # noqa Apr 13 09:39:35 devstack cinder-volume[82080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 09:39:35 devstack cinder-volume[82080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 09:39:35 devstack cinder-volume[82080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 09:39:35 devstack cinder-volume[82080]: INFO dbcounter [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Registered counter for database cinder Apr 13 09:39:35 devstack cinder-volume[82080]: DEBUG oslo_db.sqlalchemy.engines [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG dbcounter [-] [82080] Writer thread running {{(pid=82080) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 09:39:36 devstack cinder-volume[82080]: INFO cinder.rpc [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 09:39:36 devstack cinder-volume[82080]: INFO cinder.rpc [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_db.sqlalchemy.engines [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:36 devstack cinder-volume[82080]: INFO cinder.volume.manager [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Determined volume DB was empty at startup. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG cinder.volume.manager [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82080) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 09:39:36 devstack cinder-volume[82080]: WARNING stevedore.named [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 09:39:36 devstack cinder-volume[82080]: WARNING castellan.key_manager [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:39:36 devstack cinder-volume[82080]: WARNING cinder.keymgr.conf_key_mgr [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 09:39:36 devstack cinder-volume[82080]: INFO cinder.volume.manager [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_db.sqlalchemy.engines [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:36 devstack cinder-volume[82080]: INFO oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Starting 1 workers Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Started child 82295 {{(pid=82080) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Full set of CONF: {{(pid=82080) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] ******************************************************************************** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Configuration options gathered from: {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] ================================================================================ {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] allow_availability_zone_fallback = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] allow_compression_on_image_upload = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] allowed_direct_url_schemes = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] api_rate_limit = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] auth_strategy = keystone {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_availability_zone = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_host = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_stats_polling_interval = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backup_api_class = cinder.backup.api.API {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backup_name_template = backup-%s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backup_use_same_host = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backup_use_temp_snapshot = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] chap_password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] chap_username = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_internal_tenant_project_id = d97c7fc0151c48d4b3edd676ae0e20c6 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_internal_tenant_user_id = 16a3b391e1f24b6b9c5c6a8b370ce46b {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cluster = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] compression_format = gzip {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] compute_api_class = cinder.compute.nova.API {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] config_dir = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] config_source = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] control_exchange = openstack {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] debug = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] default_availability_zone = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] default_group_type = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] default_volume_type = QuobyteHD {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] disk_geometry = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] driver_client_cert = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82295]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] driver_client_cert_key = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] driver_data_namespace = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] driver_ssl_cert_path = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] driver_ssl_cert_verify = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] driver_use_ssl = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] enable_new_services = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] enable_unsupported_driver = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] enabled_backends = ['QuobyteHD'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] enforce_multipath_for_image_xfer = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] filter_function = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_api_insecure = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_api_servers = ['http://192.168.122.58/image'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_api_ssl_compression = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_ca_certificates_file = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_catalog_info = image:glance:publicURL {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_num_retries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance_request_timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] goodness_function = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] graceful_shutdown_timeout = 5 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] group_api_class = cinder.group.api.API {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] host = devstack {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_compress_on_upload = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_conversion_address_space_limit = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_conversion_cpu_limit = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_conversion_disable = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_upload_use_cinder_backend = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_upload_use_internal_tenant = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_volume_cache_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_volume_cache_max_count = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] image_volume_cache_max_size_gb = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] init_host_max_objects_retrieval = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] instance_format = [instance: %(uuid)s] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] iscsi_target_flags = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] iscsi_write_cache = on {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] iser_helper = tgtadm {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] iser_ip_address = 192.168.122.58 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] iser_port = 3260 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_color = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_config_append = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_dir = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_file = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_options = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_rotate_interval = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_rotate_interval_type = days {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] log_rotation_type = none {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] max_age = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] max_logfile_count = 30 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] max_logfile_size_mb = 200 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] max_over_subscription_ratio = 20.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] message_reap_interval = 86400 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] message_ttl = 2592000 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] migration_create_volume_timeout_secs = 300 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] monkey_patch = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] monkey_patch_modules = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] my_ip = 192.168.122.58 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] no_snapshot_gb_quota = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] num_iser_scan_tries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] num_shell_tries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] num_volume_device_scan_tries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] nvmeof_conn_info_version = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] nvmet_ns_id = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] nvmet_port_id = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_max_limit = 1000 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_volume_ext_list = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_volume_listen_port = 8776 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_volume_use_ssl = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] osapi_volume_workers = 2 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] per_volume_size_limit = -1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] periodic_fuzzy_delay = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] periodic_interval = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] public_endpoint = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] publish_errors = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_backup_gigabytes = 1000 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_backups = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_gigabytes = 1000 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_groups = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82295) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_snapshots = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] quota_volumes = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] rate_limit_burst = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] rate_limit_except_level = CRITICAL {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] rate_limit_interval = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] reinit_driver_count = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] replication_device = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] report_discard_supported = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] report_interval = 120 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] reservation_clean_interval = 86400 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] reservation_expire = 86400 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] reserved_image_namespaces = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] reserved_percentage = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] rpc_response_timeout = 120 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] run_external_periodic_tasks = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] scst_target_driver = iscsi {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] scst_target_iqn_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_down_time = 720 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] shell_completion = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] snapshot_name_template = snapshot-%s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] split_loggers = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] state_path = /opt/stack/data/cinder {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] storage_availability_zone = nova {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] storage_protocol = iSCSI {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] syslog_log_facility = LOG_USER {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] target_helper = lioadm {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] target_ip_address = 192.168.122.58 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] target_port = 3260 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] target_protocol = iscsi {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] target_secondary_ip_addresses = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] trace_flags = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] transport_url = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] until_refresh = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_chap_auth = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_default_quota_class = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_journal = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_json = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_multipath_for_image_xfer = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_stderr = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] use_syslog = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] verify_glance_signatures = enabled {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_api_class = cinder.volume.api.API {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_backend_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_clear = zero {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_clear_ionice = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_clear_size = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_copy_bps_limit = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_dd_blocksize = 1M {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_name_template = volume-%s {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_service_inithost_offload = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volume_usage_audit_period = month {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] zoning_mode = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_concurrency.disable_process_locking = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.admin_password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.admin_token = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.admin_user = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_port = 35357 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_protocol = https {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_section = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_type = password {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_uri = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.auth_version = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.cache = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.identity_uri = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.include_service_catalog = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.insecure = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.interface = public {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_password = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcache_username = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.region_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.service_type = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.58/identity {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.backend = dogpile.cache.null {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.backend_argument = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.backend_expiration_time = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.config_prefix = cache.oslo {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.debug_cache_backend = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.enable_retry_client = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.enable_socket_keepalive = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.enforce_fips_mode = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.expiration_time = 600 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.hashclient_retry_attempts = 2 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_dead_retry = 300 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_pool_maxsize = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_sasl_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.proxies = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.redis_db = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.redis_server = localhost:6379 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.retry_attempts = 2 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.retry_delay = 0.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.socket_keepalive_count = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.socket_keepalive_idle = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.socket_keepalive_interval = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.socket_timeout = 1.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.tls_allowed_ciphers = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.tls_cafile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.tls_certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.tls_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.tls_keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cache.username = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] coordination.backend_url = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.asyncio_connection = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.asyncio_slave_connection = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.backend = sqlalchemy {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.connection = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.connection_debug = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.connection_parameters = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.connection_recycle_time = 3600 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.connection_trace = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.db_inc_retry_interval = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.db_max_retries = 20 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.db_max_retry_interval = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.db_retry_interval = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.max_overflow = 50 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.max_pool_size = 5 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.max_retries = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.mysql_wsrep_sync_wait = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.pool_timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.retry_interval = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.slave_connection = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.sqlite_synchronous = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.synchronous_reader = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] database.use_db_reconnect = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.connection_string = messaging:// {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.es_doc_type = notification {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.es_scroll_size = 10000 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.es_scroll_time = 2m {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.filter_error_trace = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82295) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 09:39:36 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 09:39:36 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Running cmd (subprocess): mount.quobyte {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.hmac_keys = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.sentinel_service_name = mymaster {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.socket_timeout = 0.1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.trace_requests = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler.trace_sqlalchemy = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler_jaeger.process_tags = {} {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler_jaeger.service_name_prefix = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] profiler_otlp.service_name_prefix = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.enforce_new_defaults = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: WARNING oslo_config.cfg [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.enforce_scope = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.policy_default_rule = default {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.policy_file = policy.yaml {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.group = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.helper_command = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] privsep_osbrick.user = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.group = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.helper_command = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] cinder_sys_admin.user = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.auth_section = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.auth_type = password {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.cafile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.collect_timing = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.insecure = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.send_service_user_token = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.split_loggers = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] service_user.timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.auth_section = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.auth_type = password {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.collect_timing = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.insecure = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.region_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.split_loggers = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] glance.timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.backend_availability_zone = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.chap_password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.chap_username = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.disk_geometry = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.driver_client_cert = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.driver_client_cert_key = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.driver_data_namespace = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.driver_use_ssl = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.extra_capabilities = {} {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.filter_function = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.goodness_function = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.iscsi_target_flags = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.iscsi_write_cache = on {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.iser_helper = tgtadm {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.iser_ip_address = 192.168.122.58 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.iser_port = 3260 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_host = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_login = admin {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_mount_options = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_private_key = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_share_path = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.num_shell_tries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.quobyte_volume_url = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.replication_device = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.report_discard_supported = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.reserved_percentage = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.target_helper = tgtadm {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.target_ip_address = 192.168.122.58 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.target_port = 3260 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.target_protocol = iscsi {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.trace_flags = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.unique_fqdn_network = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.use_chap_auth = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_backend_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_clear = zero {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_clear_ionice = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_clear_size = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_reports.file_event_handler = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_reports.log_dir = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.backend_availability_zone = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.backend_host = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.chap_password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.chap_username = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.chiscsi_conf = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.disk_geometry = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.driver_client_cert = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.driver_data_namespace = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.driver_use_ssl = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.extra_capabilities = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.filter_function = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.goodness_function = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.iser_helper = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.iser_ip_address = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.iser_port = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.iser_target_prefix = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_host = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack quobyte-client[82305]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_login = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_mount_options = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_password = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_private_key = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_share_path = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack quobyte-client[82305]: Invalid parameters found, error: missing mount point. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_ssh_port = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.num_shell_tries = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack quobyte-client[82305]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.nvmet_port_id = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack quobyte-client[82305]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.replication_device = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.report_discard_supported = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.reserved_percentage = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.scst_target_driver = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.storage_protocol = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.target_helper = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.target_ip_address = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.target_port = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.target_prefix = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.target_protocol = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.trace_flags = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.use_chap_auth = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_clear = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_clear_size = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] QuobyteHD.volumes_dir = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack sudo[82312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack sudo[82312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] CMD "mount.quobyte" returned: 1 in 0.173s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.ssl = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_notifications.driver = [] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_notifications.retry = -1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] key_manager.fixed_key = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.barbican_api_version = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.barbican_endpoint = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.barbican_endpoint_type = public {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.barbican_region_name = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.cafile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.collect_timing = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.insecure = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.number_of_retries = 60 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.retry_delay = 1 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.send_service_user_token = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.split_loggers = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.verify_ssl = True {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican.verify_ssl_path = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.auth_section = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.auth_type = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.cafile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.certfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.collect_timing = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.insecure = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.keyfile = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.split_loggers = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] barbican_service_user.timeout = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.approle_role_id = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.approle_secret_id = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.kv_mountpoint = secret {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.kv_path = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.kv_version = 2 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.namespace = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.root_token_id = **** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.ssl_ca_crt_file = None {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.timeout = 60.0 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.use_ssl = False {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 09:39:36 devstack cinder-volume[82080]: DEBUG oslo_service.backend._eventlet.service [None req-77f8a2e1-03c6-49ee-8295-bc924332dd63 None None] ******************************************************************************** {{(pid=82080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.511s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:37 devstack cinder-volume[82295]: INFO cinder.volume.driver [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Driver hasn't implemented _init_vendor_properties() Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.volume.driver [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82295) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_db.sqlalchemy.engines [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 09:39:37 devstack sudo[82312]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writer thread running {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.db.sqlalchemy.api [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Building query based on filter {{(pid=82295) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82295) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:37 devstack cinder-volume[82295]: INFO cinder.keymgr.migration [None req-8e134d1f-e861-4994-a00b-f1a4a3dd9911 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 09:39:37 devstack sudo[82323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:37 devstack sudo[82323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:37 devstack sudo[82323]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.639s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:39:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Driver initialization completed successfully. Apr 13 09:39:37 devstack cinder-volume[82295]: INFO cinder.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Initiating service 3 cleanup Apr 13 09:39:37 devstack cinder-volume[82295]: INFO cinder.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Service 3 cleanup completed. Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.service [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Creating RPC server for service cinder-volume {{(pid=82295) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 09:39:37 devstack cinder-volume[82295]: DEBUG cinder.service [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82295) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 09:39:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:39:38 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:39:38 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:39:38 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Apr 13 09:39:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.409s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:39:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-150fbd6c-6b67-4089-b2fb-457b75f6d9fd None None] Driver post RPC initialization completed successfully. Apr 13 09:39:46 devstack cinder-volume[82080]: DEBUG dbcounter [-] [82080] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82080) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:39:47 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=2 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:39:48 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:40:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6a53362a-2db0-4f7f-95c1-40ff1254bca8 tempest-GroupSnapshotsV319Test-922094943 None] Group tempest-GroupSnapshotsV319Test-Group-1915843185: creating Apr 13 09:40:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6a53362a-2db0-4f7f-95c1-40ff1254bca8 tempest-GroupSnapshotsV319Test-922094943 None] Group tempest-GroupSnapshotsV319Test-Group-1915843185: created successfully Apr 13 09:40:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6a53362a-2db0-4f7f-95c1-40ff1254bca8 tempest-GroupSnapshotsV319Test-922094943 None] Create group completed successfully. Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Flow 'volume_create_manager' (bd13d160-a94f-4e4e-a3b3-b1d8359a4c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4840a8-801b-458c-b812-eeb47ee3adbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4840a8-801b-458c-b812-eeb47ee3adbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-675853013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626a3180-90d3-4d33-b9ee-726c8b22bebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47f08adb53842229dab427035ab73ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:40:37Z,use_quota=True,user_id='ee6a19797a96447ba5814ccc18494153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4441ef-16d3-4efc-b806-00d6f032f784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4441ef-16d3-4efc-b806-00d6f032f784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c958097b-f272-4ca0-8070-6fc018a742c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c958097b-f272-4ca0-8070-6fc018a742c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626a3180-90d3-4d33-b9ee-726c8b22bebb', 'volume_name': 'volume-626a3180-90d3-4d33-b9ee-726c8b22bebb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5730628-d912-4a85-bdde-117317e626b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5730628-d912-4a85-bdde-117317e626b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59986ef-01ec-4eec-88ee-f178dc396362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Volume 626a3180-90d3-4d33-b9ee-726c8b22bebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626a3180-90d3-4d33-b9ee-726c8b22bebb', 'volume_size': 1} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-675853013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626a3180-90d3-4d33-b9ee-726c8b22bebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47f08adb53842229dab427035ab73ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:40:37Z,use_quota=True,user_id='ee6a19797a96447ba5814ccc18494153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Creating volume 626a3180-90d3-4d33-b9ee-726c8b22bebb {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:40:37 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:37 devstack sudo[82871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb 1073741824 Apr 13 09:40:37 devstack sudo[82871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Flow 'volume_create_manager' (591ca7b0-1143-48a5-af9e-992f49929179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cf358b-55c8-4aca-b678-06b2172b105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cf358b-55c8-4aca-b678-06b2172b105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-188780623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c64375e-5484-4fd2-aedc-f1f666a45e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f695dbeddec543d7889ce887476858bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:40:37Z,use_quota=True,user_id='be31fee6c69e456293faaae7608405b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbef91dd-3314-45e8-944b-44be761a60de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbef91dd-3314-45e8-944b-44be761a60de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff71825-ad27-4668-8b6b-eaac3afb3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff71825-ad27-4668-8b6b-eaac3afb3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c64375e-5484-4fd2-aedc-f1f666a45e28', 'volume_name': 'volume-4c64375e-5484-4fd2-aedc-f1f666a45e28', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7de18e-33e5-40dd-a793-3237a16e4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7de18e-33e5-40dd-a793-3237a16e4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d0c182-eb44-4019-ab0e-a204bcc407cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:37 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Volume 4c64375e-5484-4fd2-aedc-f1f666a45e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c64375e-5484-4fd2-aedc-f1f666a45e28', 'volume_size': 1} Apr 13 09:40:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:38 devstack sudo[82871]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb 1073741824" returned: 0 in 1.305s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:38 devstack sudo[83191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb Apr 13 09:40:38 devstack sudo[83191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Flow 'volume_create_manager' (e51a94c4-9997-4fc9-9441-1d26caaa5d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48b6468-1640-4fc5-81c7-7f6b8e9df414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48b6468-1640-4fc5-81c7-7f6b8e9df414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193973592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=039c886c-7240-4aba-b2ff-756ac689117c,host='devstack@QuobyteHD#QuobyteHD',id=56aa8fff-1f5d-4d71-96fc-09e49bc95b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5fba94faea4df2b9c9c73b2c91115c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:40:39Z,use_quota=True,user_id='d5b79101c21a4013a277bf494f2d5cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b47cc33b-6d61-4b35-ad4d-b5d506881525),volume_type_id=b47cc33b-6d61-4b35-ad4d-b5d506881525)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab1e56f-e5f1-4ee7-b273-7231c7c2c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab1e56f-e5f1-4ee7-b273-7231c7c2c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912dadfb-3763-43ec-9c05-efed48eca86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912dadfb-3763-43ec-9c05-efed48eca86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56aa8fff-1f5d-4d71-96fc-09e49bc95b58', 'volume_name': 'volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f48e44-7963-4833-a8ba-5f6e13dc9909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f48e44-7963-4833-a8ba-5f6e13dc9909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b625fcaf-451e-4d10-8858-3f67f8d9dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:39 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Volume 56aa8fff-1f5d-4d71-96fc-09e49bc95b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58', 'volume_size': 1} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:39 devstack sudo[83191]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb" returned: 0 in 0.902s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-188780623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c64375e-5484-4fd2-aedc-f1f666a45e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f695dbeddec543d7889ce887476858bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:40:37Z,use_quota=True,user_id='be31fee6c69e456293faaae7608405b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Creating volume 4c64375e-5484-4fd2-aedc-f1f666a45e28 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:40:39 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:39 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 1073741824 Apr 13 09:40:39 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59986ef-01ec-4eec-88ee-f178dc396362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626a3180-90d3-4d33-b9ee-726c8b22bebb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c221d5ff-fa29-4083-8b39-1327d422d1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:39 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Volume volume-626a3180-90d3-4d33-b9ee-726c8b22bebb (626a3180-90d3-4d33-b9ee-726c8b22bebb): created successfully Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c221d5ff-fa29-4083-8b39-1327d422d1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Flow 'volume_create_manager' (bd13d160-a94f-4e4e-a3b3-b1d8359a4c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:40:39 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b093aff8-3170-4d36-8c79-0a1d0a98c6a0 tempest-ServerRescueNegativeTestJSON-82174994 None] Created volume successfully. Apr 13 09:40:41 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 1073741824" returned: 0 in 1.722s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:41 devstack sudo[83224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 Apr 13 09:40:41 devstack sudo[83224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:42 devstack sudo[83224]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28" returned: 0 in 1.138s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.950s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.400s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=039c886c-7240-4aba-b2ff-756ac689117c,created_at=2026-04-13T07:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193973592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=039c886c-7240-4aba-b2ff-756ac689117c,host='devstack@QuobyteHD#QuobyteHD',id=56aa8fff-1f5d-4d71-96fc-09e49bc95b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5fba94faea4df2b9c9c73b2c91115c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:40:39Z,use_quota=True,user_id='d5b79101c21a4013a277bf494f2d5cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b47cc33b-6d61-4b35-ad4d-b5d506881525),volume_type_id=b47cc33b-6d61-4b35-ad4d-b5d506881525)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Creating volume 56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:40:42 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:42 devstack sudo[83230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 1073741824 Apr 13 09:40:42 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d0c182-eb44-4019-ab0e-a204bcc407cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c64375e-5484-4fd2-aedc-f1f666a45e28', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c320c4-84c0-449f-8e3a-7e31b5561419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:42 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Volume volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 (4c64375e-5484-4fd2-aedc-f1f666a45e28): created successfully Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c320c4-84c0-449f-8e3a-7e31b5561419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Flow 'volume_create_manager' (591ca7b0-1143-48a5-af9e-992f49929179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:40:42 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-86748114-7568-48d9-881a-e25738d7820d tempest-DeleteServersTestJSON-1647089907 None] Created volume successfully. Apr 13 09:40:44 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 1073741824" returned: 0 in 1.987s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:44 devstack sudo[83265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 Apr 13 09:40:44 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:45 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" returned: 0 in 0.701s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] <== create_volume: return (2802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.804s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b625fcaf-451e-4d10-8858-3f67f8d9dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1945037b-941a-4cee-a482-c9cd69d2c37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:40:45 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Volume volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 (56aa8fff-1f5d-4d71-96fc-09e49bc95b58): created successfully Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1945037b-941a-4cee-a482-c9cd69d2c37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:40:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Flow 'volume_create_manager' (e51a94c4-9997-4fc9-9441-1d26caaa5d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:40:45 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b1cd2d88-b904-44cc-875b-f648dfe97350 tempest-GroupSnapshotsV319Test-922094943 None] Created volume successfully. Apr 13 09:40:46 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] GroupSnapshot 31d94354-5537-4d16-9ce2-d05184724e5a: creating. Apr 13 09:40:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Group snapshot 31d94354-5537-4d16-9ce2-d05184724e5a: creating. {{(pid=82295) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 09:40:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Creating offline snapshot c0e0ad4d-5a60-48a7-93de-feca74c3c481 of volume 56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:40:46 devstack cinder-volume[82295]: INFO oslo.privsep.daemon [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbj6ed_4o/privsep.sock'] Apr 13 09:40:46 devstack sudo[83307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbj6ed_4o/privsep.sock Apr 13 09:40:46 devstack sudo[83307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 09:40:46 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 09:40:47 devstack cinder-volume[82295]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 13 09:40:48 devstack sudo[83307]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:48 devstack cinder-volume[82295]: INFO oslo.privsep.daemon [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Spawned new privsep daemon via rootwrap Apr 13 09:40:48 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Accepted privsep connection to /tmp/tmpbj6ed_4o/privsep.sock {{(pid=82295) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 13 09:40:48 devstack cinder-volume[82295]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 13 09:40:48 devstack cinder-volume[82295]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 13 09:40:48 devstack cinder-volume[82295]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 13 09:40:48 devstack cinder-volume[82295]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83336 Apr 13 09:40:48 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb3ef2-a0ed-477e-9e87-a7c6091e8c1c]: (2,) {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:40:48 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ff38d-63b8-4319-a682-d02064cd83dc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:40:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:48 devstack sudo[83339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 Apr 13 09:40:48 devstack sudo[83339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:49 devstack sudo[83339]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" returned: 0 in 1.019s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:49 devstack sudo[83355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 1G Apr 13 09:40:49 devstack sudo[83355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:49 devstack cinder-volume[82295]: WARNING py.warnings [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 13 09:40:49 devstack cinder-volume[82295]: .first() Apr 13 09:40:49 devstack cinder-volume[82295]: Apr 13 09:40:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:40:49 devstack sudo[83355]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 1G" returned: 0 in 0.705s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:49 devstack sudo[83388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 Apr 13 09:40:49 devstack sudo[83388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:50 devstack sudo[83388]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481" returned: 0 in 0.776s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:50 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:40:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:50 devstack sudo[83425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 Apr 13 09:40:50 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:51 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:51 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info Apr 13 09:40:51 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:52 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info" returned: 0 in 1.082s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:52 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:40:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:52 devstack sudo[83437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info Apr 13 09:40:52 devstack sudo[83437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:53 devstack sudo[83437]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.info" returned: 0 in 0.781s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.718s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.748s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:40:53 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15020cf-946e-43f2-9235-4b521e8a2681]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:40:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d064e10e-d588-4df8-ae4f-7a931f563016 tempest-GroupSnapshotsV319Test-922094943 None] group_snapshot 31d94354-5537-4d16-9ce2-d05184724e5a: created successfully Apr 13 09:40:53 devstack sudo[83441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 Apr 13 09:40:53 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:54 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] group_snapshot 31d94354-5537-4d16-9ce2-d05184724e5a: deleting Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] group_snapshot 31d94354-5537-4d16-9ce2-d05184724e5a: deleting {{(pid=82295) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "cinder-quobyte-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Lock "cinder-quobyte-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "cinder-quobyte-c0e0ad4d-5a60-48a7-93de-feca74c3c481" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Lock "cinder-quobyte-c0e0ad4d-5a60-48a7-93de-feca74c3c481" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Deleting offline snapshot c0e0ad4d-5a60-48a7-93de-feca74c3c481 of volume 56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] snapshot_file for this snap is: volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[83622add-410f-419a-97ba-cbd37ecd93e2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:54 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28" returned: 0 in 1.705s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.741s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:40:55 devstack sudo[83449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 Apr 13 09:40:55 devstack sudo[83449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66', 'name': 'volume-4c64375e-5484-4fd2-aedc-f1f666a45e28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6609bb6b-e229-4993-8e73-15f54a02a82b', 'enforce_multipath': True} {{(pid=82295) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 09:40:55 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-6c443c32-6231-4c83-83cf-6bb6364b6565 req-c1fa9475-1059-4a39-a494-186758a1b032 tempest-DeleteServersTestJSON-1647089907 None] attachment_update completed successfully. Apr 13 09:40:56 devstack sudo[83449]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481" returned: 0 in 1.163s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:40:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4ba479-97cf-4d04-b40a-aaef0c721b34]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:40:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:56 devstack sudo[83502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 Apr 13 09:40:56 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:57 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" returned: 0 in 1.116s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:57 devstack sudo[83892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 Apr 13 09:40:57 devstack sudo[83892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Acquiring lock "cinder-626a3180-90d3-4d33-b9ee-726c8b22bebb-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:40:58 devstack sudo[83892]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481" returned: 0 in 1.518s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "cinder-626a3180-90d3-4d33-b9ee-726c8b22bebb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:40:58 devstack sudo[83902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481 Apr 13 09:40:58 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Acquiring lock "cinder-quobyte-626a3180-90d3-4d33-b9ee-726c8b22bebb" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "cinder-quobyte-626a3180-90d3-4d33-b9ee-726c8b22bebb" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d83ed-a74f-4ea1-a123-f5d8fa43ebbd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:40:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:40:59 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb Apr 13 09:40:59 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:40:59 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root Apr 13 09:40:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58.c0e0ad4d-5a60-48a7-93de-feca74c3c481" returned: 0 in 1.229s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:40:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Lock "cinder-quobyte-c0e0ad4d-5a60-48a7-93de-feca74c3c481" released by "_delete_snapshot" :: held 5.109s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:40:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Lock "cinder-quobyte-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" released by "delete_snapshot" :: held 5.140s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:00 devstack cinder-volume[82295]: WARNING cinder.quota [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1310911762 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1310911762, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:00 devstack cinder-volume[82295]: WARNING cinder.quota [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1310911762 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1310911762, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] Created reservations ['003abc06-32ba-4111-b81a-a222e57d7058', '2761db98-947d-4419-9dc0-5388115b15da', '32c997cd-6e40-439b-9128-5bc4a433c2bd', 'e05c2d60-13a6-4c8e-bff3-2ed1fc27d567'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:00 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4062c82d-b929-4346-93ea-a71af697c981 tempest-GroupSnapshotsV319Test-922094943 None] group_snapshot 31d94354-5537-4d16-9ce2-d05184724e5a: deleted successfully Apr 13 09:41:00 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb" returned: 0 in 1.539s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:00 devstack sudo[83911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb Apr 13 09:41:00 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:00 devstack sudo[83914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:00 devstack sudo[83914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "cinder-quobyte-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Lock "cinder-quobyte-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" acquired by "delete_volume" :: waited 0.043s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:01 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78eb736-eb39-4f08-9118-2d74601b28c4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:01 devstack sudo[83918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 Apr 13 09:41:01 devstack sudo[83918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:02 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-626a3180-90d3-4d33-b9ee-726c8b22bebb" returned: 0 in 1.587s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "cinder-quobyte-626a3180-90d3-4d33-b9ee-726c8b22bebb" released by "delete_volume" :: held 3.240s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:02 devstack sudo[83914]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 1.610s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:02 devstack cinder-volume[82295]: WARNING cinder.quota [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:02 devstack cinder-volume[82295]: WARNING cinder.quota [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Created reservations ['c3e78e53-4297-455b-8025-8a84ee056d74', 'd955c272-2cd1-4ff4-a64e-e4fbc67e2f94', '38c96191-e5b4-48e8-9ef9-cadb6f31d4be', '6e17ec93-1851-4d6f-9076-6bc7d33531c4'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:02 devstack sudo[83948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:02 devstack sudo[83948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:03 devstack sudo[83918]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" returned: 0 in 1.588s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:03 devstack sudo[83990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58 Apr 13 09:41:03 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:03 devstack sudo[83948]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.880s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Deleted volume successfully. Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76809672-3acf-4791-a545-2a730f62d18a tempest-ServerRescueNegativeTestJSON-82174994 None] Lock "cinder-626a3180-90d3-4d33-b9ee-726c8b22bebb-delete_volume" released by "delete_volume" :: held 4.513s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:03 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" returned: 0 in 0.661s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Lock "cinder-quobyte-56aa8fff-1f5d-4d71-96fc-09e49bc95b58" released by "delete_volume" :: held 2.446s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:03 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Created reservations ['aa5f2307-6a54-4c61-a629-3339540a6e84'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:04 devstack cinder-volume[82295]: WARNING cinder.quota [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1310911762 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1310911762, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Created reservations ['4c09ed62-a69c-41b1-8dce-f6e82084d378', 'cc18b3b1-77dd-47b7-8efa-d9146f01ba42', 'c253b1df-8d56-4562-9f4a-305bade8bd81', '294103aa-2d65-4729-989a-f414d5008beb'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:04 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:04 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:04 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.712s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:04 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-76676fbd-6aa0-4852-978f-acfffd42eaee tempest-GroupSnapshotsV319Test-922094943 None] Delete group completed successfully. Apr 13 09:41:05 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-a0187c8c-4c1b-4a2d-8762-6e88a9555d3c req-24f8c800-10f1-43da-a98d-a59074670462 tempest-DeleteServersTestJSON-1647089907 None] Terminate volume connection completed successfully. Apr 13 09:41:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-a0187c8c-4c1b-4a2d-8762-6e88a9555d3c req-24f8c800-10f1-43da-a98d-a59074670462 tempest-DeleteServersTestJSON-1647089907 None] Deleting attachment 6609bb6b-e229-4993-8e73-15f54a02a82b. {{(pid=82295) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Acquiring lock "cinder-4c64375e-5484-4fd2-aedc-f1f666a45e28-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Lock "cinder-4c64375e-5484-4fd2-aedc-f1f666a45e28-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Acquiring lock "cinder-quobyte-4c64375e-5484-4fd2-aedc-f1f666a45e28" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Lock "cinder-quobyte-4c64375e-5484-4fd2-aedc-f1f666a45e28" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5a4fe1-a33a-4ee0-bc3d-7ab7fd90a074]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:09 devstack sudo[84072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 Apr 13 09:41:09 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:09 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28" returned: 0 in 0.541s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:09 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28 Apr 13 09:41:09 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:10 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4c64375e-5484-4fd2-aedc-f1f666a45e28" returned: 0 in 0.594s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Lock "cinder-quobyte-4c64375e-5484-4fd2-aedc-f1f666a45e28" released by "delete_volume" :: held 1.165s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Created reservations ['f2bbad90-1cd7-42f9-b4d3-d58f2223045a', '4be99e55-4a10-478e-bc56-56c151a561ac', 'abfe7f92-766c-495e-ba1e-7775e26abc33', 'c9f8b23e-30e9-4b14-8cdd-851e512877d6'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:10 devstack sudo[84081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:10 devstack sudo[84081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:11 devstack sudo[84081]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.586s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:11 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:11 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Deleted volume successfully. Apr 13 09:41:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d9108d8e-9c19-4846-b003-95617cc5d2ed tempest-DeleteServersTestJSON-1647089907 None] Lock "cinder-4c64375e-5484-4fd2-aedc-f1f666a45e28-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:13 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0bd57674-7dad-4509-a33f-5c60958b36d8 tempest-GroupsTest-101994497 None] Group tempest-Group1-914016362: creating Apr 13 09:41:13 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0bd57674-7dad-4509-a33f-5c60958b36d8 tempest-GroupsTest-101994497 None] Group tempest-Group1-914016362: created successfully Apr 13 09:41:13 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0bd57674-7dad-4509-a33f-5c60958b36d8 tempest-GroupsTest-101994497 None] Create group completed successfully. Apr 13 09:41:14 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-53f4fd7c-65a9-4d86-9ac6-d2d927bc78d3 tempest-GroupsTest-101994497 None] Group tempest-Group2-2054106160: creating Apr 13 09:41:14 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-53f4fd7c-65a9-4d86-9ac6-d2d927bc78d3 tempest-GroupsTest-101994497 None] Group tempest-Group2-2054106160: created successfully Apr 13 09:41:14 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-53f4fd7c-65a9-4d86-9ac6-d2d927bc78d3 tempest-GroupsTest-101994497 None] Create group completed successfully. Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Flow 'volume_create_manager' (2d4c4dd0-4f73-411d-8a0b-d87c407e9977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ca454-01c0-49ec-983d-ec5f2af0a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ca454-01c0-49ec-983d-ec5f2af0a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939659604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53377bf2-6409-496f-925a-d4b3ed8d61ac,host='devstack@QuobyteHD#QuobyteHD',id=dcd14731-6951-4a1a-a116-37015b2b2d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45862d04ef294d83902c8e73034429ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:16Z,use_quota=True,user_id='a533c1e22add4b8a899387823b5ee901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00d81db0-e22e-4ad9-a315-7a5b95c2f47f),volume_type_id=00d81db0-e22e-4ad9-a315-7a5b95c2f47f)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90cf1c4-aa55-45c5-8ec0-c605caa8d77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90cf1c4-aa55-45c5-8ec0-c605caa8d77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf410fe-7d44-4f6b-850b-781f397d7cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf410fe-7d44-4f6b-850b-781f397d7cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd14731-6951-4a1a-a116-37015b2b2d85', 'volume_name': 'volume-dcd14731-6951-4a1a-a116-37015b2b2d85', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e292760-c882-4bde-9fba-9737057e3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e292760-c882-4bde-9fba-9737057e3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662de21f-2db0-4784-a854-4bddc3261d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:15 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Volume dcd14731-6951-4a1a-a116-37015b2b2d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd14731-6951-4a1a-a116-37015b2b2d85', 'volume_size': 1} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53377bf2-6409-496f-925a-d4b3ed8d61ac,created_at=2026-04-13T07:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939659604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53377bf2-6409-496f-925a-d4b3ed8d61ac,host='devstack@QuobyteHD#QuobyteHD',id=dcd14731-6951-4a1a-a116-37015b2b2d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45862d04ef294d83902c8e73034429ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:16Z,use_quota=True,user_id='a533c1e22add4b8a899387823b5ee901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00d81db0-e22e-4ad9-a315-7a5b95c2f47f),volume_type_id=00d81db0-e22e-4ad9-a315-7a5b95c2f47f)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Creating volume dcd14731-6951-4a1a-a116-37015b2b2d85 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:41:15 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:41:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:15 devstack sudo[84140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 1073741824 Apr 13 09:41:15 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:16 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 1073741824" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:16 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 Apr 13 09:41:16 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:16 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662de21f-2db0-4784-a854-4bddc3261d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd14731-6951-4a1a-a116-37015b2b2d85', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafdbc20-2a77-4645-87f3-e56c9f5448a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Volume volume-dcd14731-6951-4a1a-a116-37015b2b2d85 (dcd14731-6951-4a1a-a116-37015b2b2d85): created successfully Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafdbc20-2a77-4645-87f3-e56c9f5448a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Flow 'volume_create_manager' (2d4c4dd0-4f73-411d-8a0b-d87c407e9977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:16 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1e0735dc-5680-4a2a-8ec6-cd84aca6cc09 tempest-GroupsTest-101994497 None] Created volume successfully. Apr 13 09:41:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Acquiring lock "cinder-quobyte-dcd14731-6951-4a1a-a116-37015b2b2d85" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Lock "cinder-quobyte-dcd14731-6951-4a1a-a116-37015b2b2d85" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac2ef31-21a7-4952-9f21-7eac59c44c9e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:18 devstack sudo[84180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 Apr 13 09:41:18 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:19 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85" returned: 0 in 0.685s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:19 devstack sudo[84185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85 Apr 13 09:41:19 devstack sudo[84185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:19 devstack sudo[84185]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-dcd14731-6951-4a1a-a116-37015b2b2d85" returned: 0 in 0.579s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Lock "cinder-quobyte-dcd14731-6951-4a1a-a116-37015b2b2d85" released by "delete_volume" :: held 1.294s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Created reservations ['f70c718c-7b98-4989-9eee-6559cb6b1016'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:19 devstack cinder-volume[82295]: WARNING cinder.quota [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-889371063 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-889371063, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:19 devstack cinder-volume[82295]: WARNING cinder.quota [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-889371063 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-889371063, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Created reservations ['4d4a5002-e6f9-4ea4-9605-8c8f92c957f4', '85d34af2-706a-43c1-96c6-b44815161925', '97424229-6e30-4279-bdf5-d591a2d5c7d0', '0e9110f8-484a-433a-8719-a3477819cc9d'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:19 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:19 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:20 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.553s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:20 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-85856af2-a176-45af-ad68-2a2eedce74e9 tempest-GroupsTest-101994497 None] Delete group completed successfully. Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Created reservations ['9692adae-f43a-4398-b7df-fdf89106caf1'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:20 devstack sudo[84194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:20 devstack sudo[84194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:21 devstack sudo[84194]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.702s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:21 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-74ed54a3-84fd-4efa-93a6-4b13f70217e6 tempest-GroupsTest-101994497 None] Delete group completed successfully. Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Flow 'volume_create_manager' (c2770c2c-ac98-46e8-9940-89e18fb34fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8ebe9e-a201-440c-94f2-6fd3e48e0582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8ebe9e-a201-440c-94f2-6fd3e48e0582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1232729230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266e6515-25f3-4393-b771-2918fd7d8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb47f49f00f644e38a4473337461c87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:22Z,use_quota=True,user_id='5b4292591b5646c7a2aca6d17283eed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861778de-8720-496c-9d3c-5a6e3cf54d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861778de-8720-496c-9d3c-5a6e3cf54d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3a5b0e-8b1d-4fd5-abb9-0fe34e961fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3a5b0e-8b1d-4fd5-abb9-0fe34e961fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266e6515-25f3-4393-b771-2918fd7d8fc6', 'volume_name': 'volume-266e6515-25f3-4393-b771-2918fd7d8fc6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0975f22e-ccd3-4578-99b3-f459648fce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0975f22e-ccd3-4578-99b3-f459648fce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba4ae53-dc99-44f7-b0b0-b29a9e9820db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:22 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Volume 266e6515-25f3-4393-b771-2918fd7d8fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266e6515-25f3-4393-b771-2918fd7d8fc6', 'volume_size': 1} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1232729230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266e6515-25f3-4393-b771-2918fd7d8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb47f49f00f644e38a4473337461c87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:22Z,use_quota=True,user_id='5b4292591b5646c7a2aca6d17283eed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Creating volume 266e6515-25f3-4393-b771-2918fd7d8fc6 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:41:22 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:41:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6d1f607d-dbc4-4113-aabe-2356f96267a8 tempest-GroupsTest-101994497 None] Group tempest-GroupsTest-Group-351844190: creating Apr 13 09:41:22 devstack sudo[84197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 1073741824 Apr 13 09:41:22 devstack sudo[84197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6d1f607d-dbc4-4113-aabe-2356f96267a8 tempest-GroupsTest-101994497 None] Group tempest-GroupsTest-Group-351844190: created successfully Apr 13 09:41:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6d1f607d-dbc4-4113-aabe-2356f96267a8 tempest-GroupsTest-101994497 None] Create group completed successfully. Apr 13 09:41:23 devstack sudo[84197]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 1073741824" returned: 0 in 0.769s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:23 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 Apr 13 09:41:23 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Flow 'volume_create_manager' (216fddb2-926b-4994-8dcc-6a57553f0528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d07be0-aace-4d64-b012-a0d0ab5ad611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d07be0-aace-4d64-b012-a0d0ab5ad611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1891221277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dac5d0dc-7dd8-486e-a4ae-5535e54b53d3,host='devstack@QuobyteHD#QuobyteHD',id=819e3bfa-2867-4cba-b645-9aeb649c7dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45862d04ef294d83902c8e73034429ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:24Z,use_quota=True,user_id='a533c1e22add4b8a899387823b5ee901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f300b4-13e5-471d-bb5f-92d581363bb9),volume_type_id=52f300b4-13e5-471d-bb5f-92d581363bb9)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb78444-de1e-4f4c-965a-49668a47c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb78444-de1e-4f4c-965a-49668a47c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cf952d-197e-4d16-aa0a-55f014551d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cf952d-197e-4d16-aa0a-55f014551d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819e3bfa-2867-4cba-b645-9aeb649c7dd2', 'volume_name': 'volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f0e4e9-42f4-4d20-b699-a47a40a412b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f0e4e9-42f4-4d20-b699-a47a40a412b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b888f76-1296-4434-abe1-0052f9f12f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:24 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Volume 819e3bfa-2867-4cba-b645-9aeb649c7dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2', 'volume_size': 1} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:24 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6" returned: 0 in 0.977s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dac5d0dc-7dd8-486e-a4ae-5535e54b53d3,created_at=2026-04-13T07:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1891221277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dac5d0dc-7dd8-486e-a4ae-5535e54b53d3,host='devstack@QuobyteHD#QuobyteHD',id=819e3bfa-2867-4cba-b645-9aeb649c7dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45862d04ef294d83902c8e73034429ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:24Z,use_quota=True,user_id='a533c1e22add4b8a899387823b5ee901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f300b4-13e5-471d-bb5f-92d581363bb9),volume_type_id=52f300b4-13e5-471d-bb5f-92d581363bb9)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Creating volume 819e3bfa-2867-4cba-b645-9aeb649c7dd2 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:41:24 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba4ae53-dc99-44f7-b0b0-b29a9e9820db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266e6515-25f3-4393-b771-2918fd7d8fc6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4f46c3-5da4-4fd8-a342-0c58ea7317f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:24 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Volume volume-266e6515-25f3-4393-b771-2918fd7d8fc6 (266e6515-25f3-4393-b771-2918fd7d8fc6): created successfully Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4f46c3-5da4-4fd8-a342-0c58ea7317f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Flow 'volume_create_manager' (c2770c2c-ac98-46e8-9940-89e18fb34fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:24 devstack sudo[84208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 1073741824 Apr 13 09:41:24 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:24 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bfda6549-28b1-47ee-ac56-c266046880a2 tempest-VolumesAdminNegativeTest-92571371 None] Created volume successfully. Apr 13 09:41:24 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 1073741824" returned: 0 in 0.713s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:25 devstack sudo[84213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 Apr 13 09:41:25 devstack sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:25 devstack sudo[84213]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2" returned: 0 in 0.533s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b888f76-1296-4434-abe1-0052f9f12f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5a36de-e2c1-4bd1-b36e-36568bc58c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Volume volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 (819e3bfa-2867-4cba-b645-9aeb649c7dd2): created successfully Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5a36de-e2c1-4bd1-b36e-36568bc58c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Flow 'volume_create_manager' (216fddb2-926b-4994-8dcc-6a57553f0528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cc653455-469f-4de6-aecd-489154b58f20 tempest-GroupsTest-101994497 None] Created volume successfully. Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Acquiring lock "cinder-266e6515-25f3-4393-b771-2918fd7d8fc6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Lock "cinder-266e6515-25f3-4393-b771-2918fd7d8fc6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Acquiring lock "cinder-quobyte-266e6515-25f3-4393-b771-2918fd7d8fc6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Lock "cinder-quobyte-266e6515-25f3-4393-b771-2918fd7d8fc6" acquired by "delete_volume" :: waited 0.075s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Flow 'volume_create_manager' (b1bfcd98-6574-4291-b984-300a3387cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a578f6-d24f-4212-b566-74c4d48884e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc13d1c-41fe-4738-a2f8-4fd108d7a1d6]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a578f6-d24f-4212-b566-74c4d48884e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1668525765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4889a72-0546-40b3-8d35-86dc70a1c54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e14c4821def4f84a3239d4091c27966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:26Z,use_quota=True,user_id='3c172665ebe84bdc962ea68c429b2ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a052e05b-ab19-4300-80e5-04bf4d607645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a052e05b-ab19-4300-80e5-04bf4d607645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbaadea-a83b-4ba1-b67b-68969791a596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbaadea-a83b-4ba1-b67b-68969791a596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4889a72-0546-40b3-8d35-86dc70a1c54b', 'volume_name': 'volume-f4889a72-0546-40b3-8d35-86dc70a1c54b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68fc0d7-78e1-4656-ba37-cdd83c05a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68fc0d7-78e1-4656-ba37-cdd83c05a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10ed942-bd90-45c8-bf44-dd7fb269f0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Volume f4889a72-0546-40b3-8d35-86dc70a1c54b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4889a72-0546-40b3-8d35-86dc70a1c54b', 'volume_size': 1} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1668525765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4889a72-0546-40b3-8d35-86dc70a1c54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e14c4821def4f84a3239d4091c27966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:26Z,use_quota=True,user_id='3c172665ebe84bdc962ea68c429b2ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Creating volume f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:41:26 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:26 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b 1073741824 Apr 13 09:41:26 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:26 devstack sudo[84218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 Apr 13 09:41:26 devstack sudo[84218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Flow 'volume_create_manager' (a23266d3-fb16-406e-acfb-851c945a2dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae7b5bd-21f3-44fc-9f95-55122bd5f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae7b5bd-21f3-44fc-9f95-55122bd5f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-310567174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dac5d0dc-7dd8-486e-a4ae-5535e54b53d3,host='devstack@QuobyteHD#QuobyteHD',id=9b0664eb-4b78-4673-8712-d1d7818effc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45862d04ef294d83902c8e73034429ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:27Z,use_quota=True,user_id='a533c1e22add4b8a899387823b5ee901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f300b4-13e5-471d-bb5f-92d581363bb9),volume_type_id=52f300b4-13e5-471d-bb5f-92d581363bb9)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58bcfb6-9ad6-40ba-8911-6d8ae4c84751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58bcfb6-9ad6-40ba-8911-6d8ae4c84751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00576ac-7f9f-444b-96e9-08dd236ed834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00576ac-7f9f-444b-96e9-08dd236ed834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0664eb-4b78-4673-8712-d1d7818effc7', 'volume_name': 'volume-9b0664eb-4b78-4673-8712-d1d7818effc7', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2841c1e6-d3de-4b4f-a363-8af0a64bac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2841c1e6-d3de-4b4f-a363-8af0a64bac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12cc260-5683-43e1-9b3d-862e87364240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Volume 9b0664eb-4b78-4673-8712-d1d7818effc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0664eb-4b78-4673-8712-d1d7818effc7', 'volume_size': 1} Apr 13 09:41:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:27 devstack sudo[84218]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6" returned: 0 in 0.839s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:27 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6 Apr 13 09:41:27 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:27 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b 1073741824" returned: 0 in 0.885s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:27 devstack sudo[84230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b Apr 13 09:41:27 devstack sudo[84230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:27 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-266e6515-25f3-4393-b771-2918fd7d8fc6" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Lock "cinder-quobyte-266e6515-25f3-4393-b771-2918fd7d8fc6" released by "delete_volume" :: held 1.570s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Created reservations ['e871bf96-52d0-4530-9235-f867842bb5b1', '00632d64-6825-458a-833e-73ec2a5a6c90', '17803d17-cc74-4771-96a7-d21642772586', '89bc7955-f41e-41a9-a84f-4e640873b7e9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:27 devstack sudo[84230]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dac5d0dc-7dd8-486e-a4ae-5535e54b53d3,created_at=2026-04-13T07:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-310567174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dac5d0dc-7dd8-486e-a4ae-5535e54b53d3,host='devstack@QuobyteHD#QuobyteHD',id=9b0664eb-4b78-4673-8712-d1d7818effc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45862d04ef294d83902c8e73034429ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:27Z,use_quota=True,user_id='a533c1e22add4b8a899387823b5ee901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f300b4-13e5-471d-bb5f-92d581363bb9),volume_type_id=52f300b4-13e5-471d-bb5f-92d581363bb9)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Creating volume 9b0664eb-4b78-4673-8712-d1d7818effc7 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:41:27 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:27 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:27 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10ed942-bd90-45c8-bf44-dd7fb269f0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4889a72-0546-40b3-8d35-86dc70a1c54b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a059b8da-a437-45b6-86be-e41fa613b26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:27 devstack sudo[84239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 1073741824 Apr 13 09:41:27 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Volume volume-f4889a72-0546-40b3-8d35-86dc70a1c54b (f4889a72-0546-40b3-8d35-86dc70a1c54b): created successfully Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a059b8da-a437-45b6-86be-e41fa613b26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Flow 'volume_create_manager' (b1bfcd98-6574-4291-b984-300a3387cd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-aca3ee3e-a9c3-44b8-95b5-c37495aaad66 req-5d6045ee-6ff6-4383-883e-ef5af3e14f3c tempest-VolumesSnapshotsTestJSON-1317685853 None] Created volume successfully. Apr 13 09:41:28 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.600s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Deleted volume successfully. Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=85,cinder:UPDATE=86,cinder:DELETE=3,cinder:INSERT=19 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-431dd15e-c591-4bf2-a2b3-f9630ca1cc1f tempest-VolumesAdminNegativeTest-92571371 None] Lock "cinder-266e6515-25f3-4393-b771-2918fd7d8fc6-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:28 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 1073741824" returned: 0 in 0.725s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=74,cinder:UPDATE=80,cinder:INSERT=16,cinder:DELETE=7 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:28 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 Apr 13 09:41:28 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:29 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7" returned: 0 in 0.521s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.372s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12cc260-5683-43e1-9b3d-862e87364240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0664eb-4b78-4673-8712-d1d7818effc7', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2258b47c-04ba-4a32-a208-292e7e0856f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:29 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Volume volume-9b0664eb-4b78-4673-8712-d1d7818effc7 (9b0664eb-4b78-4673-8712-d1d7818effc7): created successfully Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2258b47c-04ba-4a32-a208-292e7e0856f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Flow 'volume_create_manager' (a23266d3-fb16-406e-acfb-851c945a2dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Creating offline snapshot 6aa40a37-4f0a-409a-80ab-4601a3a24f41 of volume f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52be929e-bf86-4cbb-8945-0c38f2487fcd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f0c48b17-ca78-4230-a635-b2e3b953ca6e tempest-GroupsTest-101994497 None] Created volume successfully. Apr 13 09:41:29 devstack sudo[84255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b Apr 13 09:41:29 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:29 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b" returned: 0 in 0.533s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:29 devstack sudo[84285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 1G Apr 13 09:41:29 devstack sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4c61d4c7-86fa-43b6-8ef1-0d8b77bd76dd tempest-GroupsTest-101994497 None] Update group completed successfully. Apr 13 09:41:30 devstack sudo[84285]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 1G" returned: 0 in 0.520s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4889a72-0546-40b3-8d35-86dc70a1c54b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:30 devstack sudo[84290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4889a72-0546-40b3-8d35-86dc70a1c54b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 Apr 13 09:41:30 devstack sudo[84290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:30 devstack sudo[84290]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4889a72-0546-40b3-8d35-86dc70a1c54b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:30 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 is being set with open permissions: ugo+rw Apr 13 09:41:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:30 devstack sudo[84296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 Apr 13 09:41:30 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:31 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41" returned: 0 in 0.474s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:31 devstack sudo[84301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info Apr 13 09:41:31 devstack sudo[84301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-65873b2a-6112-4f8f-92d3-75dac351c9cc tempest-GroupsTest-101994497 None] Update group completed successfully. Apr 13 09:41:31 devstack sudo[84301]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info" returned: 0 in 0.407s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:31 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info is being set with open permissions: ugo+rw Apr 13 09:41:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:31 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info Apr 13 09:41:31 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:31 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.info" returned: 0 in 0.413s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:32 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-91de0856-bb52-4e25-baa2-aee327f30504 req-7d61bf3d-978d-4dec-8f4b-fc6222b5de02 tempest-VolumesSnapshotsTestJSON-1317685853 None] Create snapshot completed successfully Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "cinder-6aa40a37-4f0a-409a-80ab-4601a3a24f41-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-6aa40a37-4f0a-409a-80ab-4601a3a24f41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "cinder-quobyte-f4889a72-0546-40b3-8d35-86dc70a1c54b" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-quobyte-f4889a72-0546-40b3-8d35-86dc70a1c54b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "cinder-quobyte-6aa40a37-4f0a-409a-80ab-4601a3a24f41" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-quobyte-6aa40a37-4f0a-409a-80ab-4601a3a24f41" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Deleting offline snapshot 6aa40a37-4f0a-409a-80ab-4601a3a24f41 of volume f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] snapshot_file for this snap is: volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc04e4-b9fa-4d31-8d00-557042c01f4b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:32 devstack sudo[84308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 Apr 13 09:41:32 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Acquiring lock "cinder-quobyte-819e3bfa-2867-4cba-b645-9aeb649c7dd2" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Lock "cinder-quobyte-819e3bfa-2867-4cba-b645-9aeb649c7dd2" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9adc448-a034-4b8b-9165-412dc89dfd95]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:32 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 Apr 13 09:41:32 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:32 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41" returned: 0 in 0.594s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4889a72-0546-40b3-8d35-86dc70a1c54b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea40cf-cb56-4926-aedb-cb2d755d80c5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:33 devstack sudo[84315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b Apr 13 09:41:33 devstack sudo[84315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:33 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2" returned: 0 in 0.566s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:33 devstack sudo[84320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2 Apr 13 09:41:33 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:33 devstack sudo[84315]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b" returned: 0 in 0.590s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:33 devstack sudo[84325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 Apr 13 09:41:33 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:33 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-819e3bfa-2867-4cba-b645-9aeb649c7dd2" returned: 0 in 0.503s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Lock "cinder-quobyte-819e3bfa-2867-4cba-b645-9aeb649c7dd2" released by "delete_volume" :: held 1.094s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Acquiring lock "cinder-quobyte-9b0664eb-4b78-4673-8712-d1d7818effc7" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Lock "cinder-quobyte-9b0664eb-4b78-4673-8712-d1d7818effc7" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7263e9-ca5d-488b-a0ab-7d01fd0d2e07]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:33 devstack sudo[84328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 Apr 13 09:41:33 devstack sudo[84328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:34 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41" returned: 0 in 0.506s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:34 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41 Apr 13 09:41:34 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:34 devstack sudo[84328]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7" returned: 0 in 0.555s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:34 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7 Apr 13 09:41:34 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:34 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b.6aa40a37-4f0a-409a-80ab-4601a3a24f41" returned: 0 in 0.547s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-quobyte-6aa40a37-4f0a-409a-80ab-4601a3a24f41" released by "_delete_snapshot" :: held 2.324s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-quobyte-f4889a72-0546-40b3-8d35-86dc70a1c54b" released by "delete_snapshot" :: held 2.350s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:34 devstack cinder-volume[82295]: WARNING cinder.quota [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.quota [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Created reservations ['f806e294-2136-4f23-ab83-74bf4d7fc17d', '028c21ef-0278-4f3c-bc02-285628c83d8d', '68ff0213-d74b-40d3-bfe4-ae0728048eac', '1f674976-f9f9-49dc-8263-da652be0ea09'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Delete snapshot completed successfully. Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-fbb4dcea-7539-4826-9ceb-3d1a08417757 req-1f501aef-8080-4191-9cf9-c32d7d01b09a tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-6aa40a37-4f0a-409a-80ab-4601a3a24f41-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:34 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9b0664eb-4b78-4673-8712-d1d7818effc7" returned: 0 in 0.539s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Lock "cinder-quobyte-9b0664eb-4b78-4673-8712-d1d7818effc7" released by "delete_volume" :: held 1.128s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Created reservations ['e34f2b48-530e-4e80-a35f-a3c9b2912a1c'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:34 devstack cinder-volume[82295]: WARNING cinder.quota [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1542658322 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1542658322, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:34 devstack cinder-volume[82295]: WARNING cinder.quota [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1542658322 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1542658322, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:41:34 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Created reservations ['8902efb2-5325-4155-8ce1-68bdf90364c3', 'dd78615c-5dcb-4b24-97b5-89b23540527f', '6e8d7409-867f-456b-8b22-91bad62056a1', 'e4e5f9da-b384-4446-85ee-7ec630681a1d'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Created reservations ['d97f5073-50c0-4d2e-b9f4-d1edececfb8c', '62750b16-b12b-45f8-bd09-15e772d042e6', 'ea701a44-a175-4e7e-8590-ea58a7111012', 'dba3c92f-964c-431f-8d5a-4dba7de8c57e'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:35 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:35 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "cinder-f4889a72-0546-40b3-8d35-86dc70a1c54b-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-f4889a72-0546-40b3-8d35-86dc70a1c54b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "cinder-quobyte-f4889a72-0546-40b3-8d35-86dc70a1c54b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-quobyte-f4889a72-0546-40b3-8d35-86dc70a1c54b" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[25262c74-4dc3-409c-8de0-a4a57cd770a2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:35 devstack sudo[84362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b Apr 13 09:41:35 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:35 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.459s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:35 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:35 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-5be8883c-d409-4800-8801-eed872d305cb tempest-GroupsTest-101994497 None] Delete group completed successfully. Apr 13 09:41:36 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b" returned: 0 in 0.552s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:36 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b Apr 13 09:41:36 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:36 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f4889a72-0546-40b3-8d35-86dc70a1c54b" returned: 0 in 0.544s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-quobyte-f4889a72-0546-40b3-8d35-86dc70a1c54b" released by "delete_volume" :: held 1.124s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG cinder.quota [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Created reservations ['84c7732f-1391-474d-8afa-682b2f7731e8', '8abaad3f-9c6a-49fc-8d92-64cfda60704a', '189c8eb9-a7e9-434e-ba74-b348d760d811', '534e4254-d26e-4f2f-beb8-df3aaebbf3f3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:36 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:36 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:37 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.573s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:37 devstack cinder-volume[82295]: DEBUG cinder.manager [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Deleted volume successfully. Apr 13 09:41:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-7e9bb480-4efe-4fee-bd75-6b972fbff8f0 req-0113f987-6536-4f55-b2d2-a3a39809fd74 tempest-VolumesSnapshotsTestJSON-1317685853 None] Lock "cinder-f4889a72-0546-40b3-8d35-86dc70a1c54b-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:41:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c18e4f12-86d1-47ec-b793-ad7d7adf0fb5 tempest-GroupsV320Test-2126430070 None] Group tempest-GroupsV320Test-Group-322853559: creating Apr 13 09:41:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c18e4f12-86d1-47ec-b793-ad7d7adf0fb5 tempest-GroupsV320Test-2126430070 None] Group tempest-GroupsV320Test-Group-322853559: created successfully Apr 13 09:41:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c18e4f12-86d1-47ec-b793-ad7d7adf0fb5 tempest-GroupsV320Test-2126430070 None] Create group completed successfully. Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Created reservations ['7074a609-c19c-4103-aed0-9376a085660f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:41 devstack sudo[84412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:41:41 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c59db9b7-db0b-40af-a2e2-0b229919ebb6 tempest-BackendsCapabilitiesAdminTestsJSON-1105433739 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82295) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 09:41:42 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.666s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:42 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:41:42 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-871d4911-a9a8-4b52-8f61-3d0149f8a364 tempest-GroupsV320Test-2126430070 None] Delete group completed successfully. Apr 13 09:41:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fdbf65f4-2455-485b-aee1-1e629694b5bf tempest-BackendsCapabilitiesAdminTestsJSON-1105433739 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579765319824, 'free_capacity_gb': 1775.7579765319824, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82295) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 09:41:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-aafd003c-0942-4102-8190-29daa1b78529 tempest-GroupsV314Test-80379071 None] Group tempest-GroupsV314Test-Group-855588982: creating Apr 13 09:41:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-aafd003c-0942-4102-8190-29daa1b78529 tempest-GroupsV314Test-80379071 None] Group tempest-GroupsV314Test-Group-855588982: created successfully Apr 13 09:41:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-aafd003c-0942-4102-8190-29daa1b78529 tempest-GroupsV314Test-80379071 None] Create group completed successfully. Apr 13 09:41:48 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Flow 'volume_create_manager' (faf3cd16-f856-4584-882f-331813c860ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26b2c28-ac83-482c-a6c6-6a939ded67d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26b2c28-ac83-482c-a6c6-6a939ded67d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-170214029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9505b378-d142-484f-97f4-7b0fad17372e,host='devstack@QuobyteHD#QuobyteHD',id=68a9c697-9f70-499b-aa07-c45b03ee5802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c19a52a371c47c5a3e1558712ddd55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:49Z,use_quota=True,user_id='e8e42c7464564ae59de8951d5c9d1831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e4f8b1a-990a-41d6-b5c5-b59c4b2b60b2),volume_type_id=5e4f8b1a-990a-41d6-b5c5-b59c4b2b60b2)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d85a53-1de5-4ab4-b3fa-c1d178146a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d85a53-1de5-4ab4-b3fa-c1d178146a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65bbed9-d7e0-436d-ae48-ee8b4cdfd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65bbed9-d7e0-436d-ae48-ee8b4cdfd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a9c697-9f70-499b-aa07-c45b03ee5802', 'volume_name': 'volume-68a9c697-9f70-499b-aa07-c45b03ee5802', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd23a47a-6af8-496d-9b65-b25e69d00551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd23a47a-6af8-496d-9b65-b25e69d00551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe216bc-f82b-4be0-bd04-1e58305f6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Volume 68a9c697-9f70-499b-aa07-c45b03ee5802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a9c697-9f70-499b-aa07-c45b03ee5802', 'volume_size': 1} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9505b378-d142-484f-97f4-7b0fad17372e,created_at=2026-04-13T07:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-170214029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9505b378-d142-484f-97f4-7b0fad17372e,host='devstack@QuobyteHD#QuobyteHD',id=68a9c697-9f70-499b-aa07-c45b03ee5802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c19a52a371c47c5a3e1558712ddd55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:49Z,use_quota=True,user_id='e8e42c7464564ae59de8951d5c9d1831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e4f8b1a-990a-41d6-b5c5-b59c4b2b60b2),volume_type_id=5e4f8b1a-990a-41d6-b5c5-b59c4b2b60b2)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Creating volume 68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:41:49 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:49 devstack sudo[84439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 1073741824 Apr 13 09:41:49 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:49 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 1073741824" returned: 0 in 0.865s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:50 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:41:50 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:50 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 0.594s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe216bc-f82b-4be0-bd04-1e58305f6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a9c697-9f70-499b-aa07-c45b03ee5802', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6e9ee4-f6dc-4188-88c3-62ef495a2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:50 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Volume volume-68a9c697-9f70-499b-aa07-c45b03ee5802 (68a9c697-9f70-499b-aa07-c45b03ee5802): created successfully Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6e9ee4-f6dc-4188-88c3-62ef495a2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Flow 'volume_create_manager' (faf3cd16-f856-4584-882f-331813c860ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-28600cc5-e7a6-497e-9b72-84a564096f4d tempest-GroupsV314Test-80379071 None] Created volume successfully. Apr 13 09:41:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:52 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Cloning volume 68a9c697-9f70-499b-aa07-c45b03ee5802 to volume d4079a76-2b48-4c8f-ade4-7cd64df57009 Apr 13 09:41:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Creating offline snapshot 0b3ad651-eded-49f2-bdee-2618222a66b6 of volume 68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:41:52 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec577c7c-9a5d-4d85-b435-5233f252d9be]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:52 devstack sudo[84498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:41:52 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Flow 'volume_create_manager' (864a9104-f9a8-4ea5-8264-f86289a9a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068466f2-797a-4e7b-bb66-fb319c7ebd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068466f2-797a-4e7b-bb66-fb319c7ebd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-858126117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a15095-4321-4fea-a76a-8f5204cc588d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c815e65e774688aecf21de9662eb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:53Z,use_quota=True,user_id='cc3c6c3b703c4c5c9e60c73e29ff0263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e80d7a-3e9d-4ff0-a64f-904acb63bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e80d7a-3e9d-4ff0-a64f-904acb63bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ecb167-ed43-4764-9b1a-116aeb89ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ecb167-ed43-4764-9b1a-116aeb89ac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a15095-4321-4fea-a76a-8f5204cc588d', 'volume_name': 'volume-f9a15095-4321-4fea-a76a-8f5204cc588d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:53 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed542b8a-6d47-4152-8462-ae869fefe87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed542b8a-6d47-4152-8462-ae869fefe87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89af04b8-bb4b-46d3-bb2d-d6a425baecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:41:53 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Volume f9a15095-4321-4fea-a76a-8f5204cc588d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a15095-4321-4fea-a76a-8f5204cc588d', 'volume_size': 1} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 1.089s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:53 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 1G Apr 13 09:41:53 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:54 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 1G" returned: 0 in 0.695s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a9c697-9f70-499b-aa07-c45b03ee5802 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:54 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a9c697-9f70-499b-aa07-c45b03ee5802 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 Apr 13 09:41:54 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:54 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a9c697-9f70-499b-aa07-c45b03ee5802 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6" returned: 0 in 0.617s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:54 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:41:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:54 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 Apr 13 09:41:54 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:55 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6" returned: 0 in 0.528s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:55 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info Apr 13 09:41:55 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:56 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info" returned: 0 in 0.594s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:56 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:56 devstack sudo[84523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info Apr 13 09:41:56 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:56 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.info" returned: 0 in 0.483s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Acquiring lock "cinder-quobyte-d4079a76-2b48-4c8f-ade4-7cd64df57009" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-d4079a76-2b48-4c8f-ade4-7cd64df57009" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] snapshot: 0b3ad651-eded-49f2-bdee-2618222a66b6, volume: d4079a76-2b48-4c8f-ade4-7cd64df57009, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e802f-9078-4352-bdb7-70483973e689]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:56 devstack sudo[84527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 Apr 13 09:41:56 devstack sudo[84527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:57 devstack sudo[84527]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a9c697-9f70-499b-aa07-c45b03ee5802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9425493-72a4-4693-b708-7852d4f510bf]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:57 devstack sudo[84536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:41:57 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:41:57 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 0.697s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:41:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:41:57 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 Apr 13 09:41:57 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:00 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009" returned: 0 in 2.370s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb06d53-294f-49f1-91cc-1d1a3bfa91dd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:00 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:42:00 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:00 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:00 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:00 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.419s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:00 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 0.707s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:42:00 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Converted 1024.00 MB image at 431.88 MB/s Apr 13 09:42:00 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:42:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:00 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 Apr 13 09:42:00 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:01 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009" returned: 0 in 0.402s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-d4079a76-2b48-4c8f-ade4-7cd64df57009" released by "_copy_volume_from_snapshot" :: held 4.760s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Acquiring lock "cinder-quobyte-0b3ad651-eded-49f2-bdee-2618222a66b6" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-0b3ad651-eded-49f2-bdee-2618222a66b6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Deleting offline snapshot 0b3ad651-eded-49f2-bdee-2618222a66b6 of volume 68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] snapshot_file for this snap is: volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2258869-18b8-4faf-8c75-dff4317fd2ee]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:01 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 Apr 13 09:42:01 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:02 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6" returned: 0 in 0.649s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a9c697-9f70-499b-aa07-c45b03ee5802(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:42:02 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f47d1d-0b0e-40df-b6de-332008a6aee5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:02 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:42:02 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:02 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 0.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:02 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 Apr 13 09:42:02 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:03 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6" returned: 0 in 1.035s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:03 devstack sudo[84665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6 Apr 13 09:42:03 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:04 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802.0b3ad651-eded-49f2-bdee-2618222a66b6" returned: 0 in 0.758s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-0b3ad651-eded-49f2-bdee-2618222a66b6" released by "_delete_snapshot" :: held 3.053s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.078s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.848s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-858126117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a15095-4321-4fea-a76a-8f5204cc588d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c815e65e774688aecf21de9662eb0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:41:53Z,use_quota=True,user_id='cc3c6c3b703c4c5c9e60c73e29ff0263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Creating volume f9a15095-4321-4fea-a76a-8f5204cc588d {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:04 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:04 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d 1073741824 Apr 13 09:42:04 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7d948399-7bb3-4694-91c1-90c575c68466 tempest-GroupsV314Test-80379071 None] Create group from source-group-9505b378-d142-484f-97f4-7b0fad17372e completed successfully. Apr 13 09:42:05 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d 1073741824" returned: 0 in 0.970s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Acquiring lock "cinder-quobyte-d4079a76-2b48-4c8f-ade4-7cd64df57009" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-d4079a76-2b48-4c8f-ade4-7cd64df57009" acquired by "delete_volume" :: waited 0.042s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9680be89-ec3a-499a-ad27-9c9eeabeab8e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:05 devstack sudo[84687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d Apr 13 09:42:05 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:05 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 Apr 13 09:42:05 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:06 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d" returned: 0 in 0.591s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89af04b8-bb4b-46d3-bb2d-d6a425baecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a15095-4321-4fea-a76a-8f5204cc588d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878dd25a-0913-4502-88a2-5eb1e2f67a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:06 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Volume volume-f9a15095-4321-4fea-a76a-8f5204cc588d (f9a15095-4321-4fea-a76a-8f5204cc588d): created successfully Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878dd25a-0913-4502-88a2-5eb1e2f67a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Flow 'volume_create_manager' (864a9104-f9a8-4ea5-8264-f86289a9a95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:06 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-97514d5a-539b-4990-a855-6c5c2efa7a36 tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Created volume successfully. Apr 13 09:42:06 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009" returned: 0 in 0.742s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:06 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009 Apr 13 09:42:06 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:07 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4079a76-2b48-4c8f-ade4-7cd64df57009" returned: 0 in 0.763s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-d4079a76-2b48-4c8f-ade4-7cd64df57009" released by "delete_volume" :: held 1.544s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Created reservations ['a95c2706-23ad-43cc-b52d-795987c926ce'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:07 devstack cinder-volume[82295]: WARNING cinder.quota [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1948293824 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1948293824, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:42:07 devstack cinder-volume[82295]: WARNING cinder.quota [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1948293824 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1948293824, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Acquiring lock "cinder-f9a15095-4321-4fea-a76a-8f5204cc588d-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Created reservations ['600c3d5f-9f37-4c4e-8b21-719e50cef448', '82e0ee23-a0a7-4cd5-949a-c8183ec32e2b', '2eda3abc-caf0-4bed-8ff8-89ce60b6b22f', '2327cb16-1570-4f4f-9025-7b49017317b1'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "cinder-f9a15095-4321-4fea-a76a-8f5204cc588d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Acquiring lock "cinder-quobyte-f9a15095-4321-4fea-a76a-8f5204cc588d" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "cinder-quobyte-f9a15095-4321-4fea-a76a-8f5204cc588d" acquired by "delete_volume" :: waited 0.029s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:07 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:07 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[73946ee4-2a3f-443a-82c5-92bc784fc5ab]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:07 devstack sudo[84726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d Apr 13 09:42:07 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:07 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.533s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-af6dc4e5-646e-47d6-8b11-641b148a7429 tempest-GroupsV314Test-80379071 None] Delete group completed successfully. Apr 13 09:42:07 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d" returned: 0 in 0.563s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:07 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d Apr 13 09:42:07 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Acquiring lock "cinder-quobyte-68a9c697-9f70-499b-aa07-c45b03ee5802" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-68a9c697-9f70-499b-aa07-c45b03ee5802" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc2a3f-be08-4e2f-a4ca-018c46ad3b5a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:08 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:42:08 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:08 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f9a15095-4321-4fea-a76a-8f5204cc588d" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "cinder-quobyte-f9a15095-4321-4fea-a76a-8f5204cc588d" released by "delete_volume" :: held 1.100s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Created reservations ['46addda7-1862-4e31-b1ac-50528f8062af', 'd37de0c7-1acb-4512-ae2b-13d0242a55f5', '4e149931-b316-491d-828e-364fbce9d6f7', '701056b3-d83c-4111-848f-31af02b22cae'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:08 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:08 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:08 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 0.595s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:08 devstack sudo[84747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802 Apr 13 09:42:08 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:08 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:08 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Deleted volume successfully. Apr 13 09:42:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5ae79f7b-e765-4bef-b417-778331c2d53e tempest-VolumeQuotasNegativeTestJSON-1072256527 None] Lock "cinder-f9a15095-4321-4fea-a76a-8f5204cc588d-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:09 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-68a9c697-9f70-499b-aa07-c45b03ee5802" returned: 0 in 0.492s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Lock "cinder-quobyte-68a9c697-9f70-499b-aa07-c45b03ee5802" released by "delete_volume" :: held 1.115s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Created reservations ['6ee85a3c-94e7-450d-a507-76d1c2774284'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Created reservations ['b14ccc1b-123f-4744-82f6-452ef99ca262', '026452db-aa60-499b-bcb5-92c5ba882b83', '936b9e71-4330-4181-9596-6196de9bf600', 'c598a2df-737d-40e7-86cb-f99867937b99'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:09 devstack sudo[84752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:09 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:09 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.550s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:09 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4aae7026-60c7-4d15-bd4f-f9d0594d5c94 tempest-GroupsV314Test-80379071 None] Delete group completed successfully. Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Flow 'volume_create_manager' (3874cade-6fde-4540-b7d8-170836f1e977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6caba17a-dd11-48fc-bf25-51805861753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6caba17a-dd11-48fc-bf25-51805861753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1163377651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b949c4-9e0c-426c-829f-013fc7967ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a7646ca2074e5eab0114de7ebe1af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:13Z,use_quota=True,user_id='339ad155c1c9477b8ee8123323f35874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84779ae1-36fb-4605-84be-0f4fcf814b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84779ae1-36fb-4605-84be-0f4fcf814b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1efecc-e6b0-4568-aa3e-a71d93521d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1efecc-e6b0-4568-aa3e-a71d93521d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b949c4-9e0c-426c-829f-013fc7967ee9', 'volume_name': 'volume-56b949c4-9e0c-426c-829f-013fc7967ee9', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f2540d-9d4d-40db-b955-3525347e4248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f2540d-9d4d-40db-b955-3525347e4248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b64bca-9a98-4123-8271-6d7688b0121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:12 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Volume 56b949c4-9e0c-426c-829f-013fc7967ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b949c4-9e0c-426c-829f-013fc7967ee9', 'volume_size': 1} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1163377651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b949c4-9e0c-426c-829f-013fc7967ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a7646ca2074e5eab0114de7ebe1af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:13Z,use_quota=True,user_id='339ad155c1c9477b8ee8123323f35874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Creating volume 56b949c4-9e0c-426c-829f-013fc7967ee9 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:12 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:12 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 1073741824 Apr 13 09:42:12 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:13 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 1073741824" returned: 0 in 0.748s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:13 devstack sudo[84789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 Apr 13 09:42:13 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:14 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9" returned: 0 in 0.715s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b64bca-9a98-4123-8271-6d7688b0121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b949c4-9e0c-426c-829f-013fc7967ee9', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f4f4e5-59f2-4648-ae0f-dd84e4e5f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:14 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Volume volume-56b949c4-9e0c-426c-829f-013fc7967ee9 (56b949c4-9e0c-426c-829f-013fc7967ee9): created successfully Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f4f4e5-59f2-4648-ae0f-dd84e4e5f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:14 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Flow 'volume_create_manager' (3874cade-6fde-4540-b7d8-170836f1e977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:14 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c4aa0d52-a9aa-48a4-9cc1-38465b7af1f3 tempest-ServersNegativeTestJSON-1381020278 None] Created volume successfully. Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Flow 'volume_create_manager' (755e2987-778b-45d8-85ba-18539547da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f150ee3e-b1d9-43bf-813c-20d7e1e2774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f150ee3e-b1d9-43bf-813c-20d7e1e2774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1237526500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1fac99-5db9-44ee-8c97-3ccca53570b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee81491c5e54c07a265b37b2e083e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:15Z,use_quota=True,user_id='d6b34e7012f747c4b6201fe178d76c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83b0bbd2-f90c-4bcc-9987-2d1a66cda0ad),volume_type_id=83b0bbd2-f90c-4bcc-9987-2d1a66cda0ad)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf73005c-520a-449b-a191-8a1aa1401217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf73005c-520a-449b-a191-8a1aa1401217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8608cf9a-3542-47b1-a4cd-d9988297e07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8608cf9a-3542-47b1-a4cd-d9988297e07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1fac99-5db9-44ee-8c97-3ccca53570b7', 'volume_name': 'volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcd7e59-f868-48d9-8b2d-22802f8ffccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcd7e59-f868-48d9-8b2d-22802f8ffccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17feff7c-d4d8-4377-8b52-b5bf9dcfcb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:15 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Volume 6b1fac99-5db9-44ee-8c97-3ccca53570b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7', 'volume_size': 1} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1237526500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1fac99-5db9-44ee-8c97-3ccca53570b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee81491c5e54c07a265b37b2e083e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:15Z,use_quota=True,user_id='d6b34e7012f747c4b6201fe178d76c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83b0bbd2-f90c-4bcc-9987-2d1a66cda0ad),volume_type_id=83b0bbd2-f90c-4bcc-9987-2d1a66cda0ad)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Creating volume 6b1fac99-5db9-44ee-8c97-3ccca53570b7 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:15 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:15 devstack sudo[84794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 1073741824 Apr 13 09:42:15 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:15 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 1073741824" returned: 0 in 0.599s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:15 devstack sudo[84800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 Apr 13 09:42:15 devstack sudo[84800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Flow 'volume_create_manager' (18d73644-31e8-4472-85f8-20a71dfc928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969bf004-6824-4c78-b340-712504d3058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969bf004-6824-4c78-b340-712504d3058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1043702947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1249613b-9f55-4eb7-9dbf-c64de6c86a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a7646ca2074e5eab0114de7ebe1af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:16Z,use_quota=True,user_id='339ad155c1c9477b8ee8123323f35874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdd864b-5e04-4465-a17d-30c85b4ad3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdd864b-5e04-4465-a17d-30c85b4ad3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a568573e-6981-4695-af2b-2239daf9e0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a568573e-6981-4695-af2b-2239daf9e0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1249613b-9f55-4eb7-9dbf-c64de6c86a9f', 'volume_name': 'volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1595d5-4911-4c17-b3f4-fab2ef56f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1595d5-4911-4c17-b3f4-fab2ef56f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdff85d-ea20-4a9b-8cda-8f2e319d525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Volume 1249613b-9f55-4eb7-9dbf-c64de6c86a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f', 'volume_size': 1} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:16 devstack sudo[84800]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1043702947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1249613b-9f55-4eb7-9dbf-c64de6c86a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78a7646ca2074e5eab0114de7ebe1af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:16Z,use_quota=True,user_id='339ad155c1c9477b8ee8123323f35874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Creating volume 1249613b-9f55-4eb7-9dbf-c64de6c86a9f {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:16 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17feff7c-d4d8-4377-8b52-b5bf9dcfcb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1200484a-b76a-47c4-ae83-c177bda1883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack sudo[84804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f 1073741824 Apr 13 09:42:16 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Volume volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 (6b1fac99-5db9-44ee-8c97-3ccca53570b7): created successfully Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1200484a-b76a-47c4-ae83-c177bda1883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Flow 'volume_create_manager' (755e2987-778b-45d8-85ba-18539547da14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:16 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8023b968-1aaa-4145-97d3-708bb186a70a tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Created volume successfully. Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Flow 'volume_create_manager' (35a9a550-ba97-458e-89c9-0c9ed4919bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545a8563-7834-4f51-9ed7-1c6de936b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545a8563-7834-4f51-9ed7-1c6de936b65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1505221523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f48d6e-35c8-4cc3-8fec-2d76e82aa204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1e3ce9af4840d683f58f493d4d69af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:17Z,use_quota=True,user_id='7195b8ba99314f36a81a86701ff979dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0206f9-f7c9-41d9-96e9-fc6f7de03626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0206f9-f7c9-41d9-96e9-fc6f7de03626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cf9ed9-05a5-4a3f-aaf7-459600a3e86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cf9ed9-05a5-4a3f-aaf7-459600a3e86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f48d6e-35c8-4cc3-8fec-2d76e82aa204', 'volume_name': 'volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b365da-0027-4642-819c-6ff269f6746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b365da-0027-4642-819c-6ff269f6746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b780cb-17de-48f6-8c98-d83a8e8e6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Volume 62f48d6e-35c8-4cc3-8fec-2d76e82aa204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204', 'volume_size': 1} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:16 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f 1073741824" returned: 0 in 0.606s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:17 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f Apr 13 09:42:17 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:17 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f" returned: 0 in 0.464s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1505221523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f48d6e-35c8-4cc3-8fec-2d76e82aa204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1e3ce9af4840d683f58f493d4d69af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:17Z,use_quota=True,user_id='7195b8ba99314f36a81a86701ff979dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Creating volume 62f48d6e-35c8-4cc3-8fec-2d76e82aa204 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:17 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:17 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 1073741824 Apr 13 09:42:17 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cdff85d-ea20-4a9b-8cda-8f2e319d525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bd7488-3708-450b-929c-051c552686fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:17 devstack sudo[84814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:17 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:17 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Volume volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f (1249613b-9f55-4eb7-9dbf-c64de6c86a9f): created successfully Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bd7488-3708-450b-929c-051c552686fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Flow 'volume_create_manager' (18d73644-31e8-4472-85f8-20a71dfc928b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:17 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2998c329-af9a-4f7d-ab70-8592977d7e9d tempest-ServersNegativeTestJSON-1381020278 None] Created volume successfully. Apr 13 09:42:17 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 1073741824" returned: 0 in 0.481s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:17 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:17 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-303aada5-01d7-4f36-a880-a3e2eb0496cb tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Retype volume completed successfully. Apr 13 09:42:17 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 Apr 13 09:42:17 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:18 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204" returned: 0 in 0.469s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b780cb-17de-48f6-8c98-d83a8e8e6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90194947-be62-483b-98ac-388ebd29f57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:18 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Volume volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 (62f48d6e-35c8-4cc3-8fec-2d76e82aa204): created successfully Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90194947-be62-483b-98ac-388ebd29f57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Flow 'volume_create_manager' (35a9a550-ba97-458e-89c9-0c9ed4919bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fd6a30ea-3f84-430a-8e6c-d975a0c4391e tempest-VolumeQuotasAdminTestJSON-1678111677 None] Created volume successfully. Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "cinder-1249613b-9f55-4eb7-9dbf-c64de6c86a9f-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-1249613b-9f55-4eb7-9dbf-c64de6c86a9f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Acquiring lock "cinder-6b1fac99-5db9-44ee-8c97-3ccca53570b7-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "cinder-quobyte-1249613b-9f55-4eb7-9dbf-c64de6c86a9f" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "cinder-6b1fac99-5db9-44ee-8c97-3ccca53570b7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-quobyte-1249613b-9f55-4eb7-9dbf-c64de6c86a9f" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2343c6c-37ae-47e0-bdf5-ed71fa7a6866]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Acquiring lock "cinder-quobyte-6b1fac99-5db9-44ee-8c97-3ccca53570b7" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "cinder-quobyte-6b1fac99-5db9-44ee-8c97-3ccca53570b7" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e513bbd0-4d97-4d44-8b25-a351fa466c67]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:18 devstack sudo[84844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f Apr 13 09:42:18 devstack sudo[84844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:18 devstack sudo[84845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 Apr 13 09:42:18 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "cinder-62f48d6e-35c8-4cc3-8fec-2d76e82aa204-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "cinder-62f48d6e-35c8-4cc3-8fec-2d76e82aa204-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "cinder-quobyte-62f48d6e-35c8-4cc3-8fec-2d76e82aa204" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "cinder-quobyte-62f48d6e-35c8-4cc3-8fec-2d76e82aa204" acquired by "delete_volume" :: waited 0.023s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb121cc-8555-4057-ab06-4fd6082f00b5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:19 devstack sudo[84848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 Apr 13 09:42:19 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:19 devstack sudo[84844]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f" returned: 0 in 0.717s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:19 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f Apr 13 09:42:19 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:19 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7" returned: 0 in 0.931s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:19 devstack sudo[84858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7 Apr 13 09:42:19 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:20 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204" returned: 0 in 1.133s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:20 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204 Apr 13 09:42:20 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:20 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1249613b-9f55-4eb7-9dbf-c64de6c86a9f" returned: 0 in 0.938s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-quobyte-1249613b-9f55-4eb7-9dbf-c64de6c86a9f" released by "delete_volume" :: held 1.736s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:20 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b1fac99-5db9-44ee-8c97-3ccca53570b7" returned: 0 in 0.723s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "cinder-quobyte-6b1fac99-5db9-44ee-8c97-3ccca53570b7" released by "delete_volume" :: held 1.692s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Created reservations ['d504cf4e-599a-437b-ac62-61b552771a22', '9aaa4b8c-9f47-4164-bac9-02468c074809', '4153867f-e0f2-41f6-803c-2aa822bf17fc', 'b1c2a4e3-81db-4539-921d-1d24c5f14d22'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:20 devstack cinder-volume[82295]: WARNING cinder.quota [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:42:20 devstack cinder-volume[82295]: WARNING cinder.quota [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Created reservations ['eb5f5e07-8006-4f8a-a1aa-d1493d72b4b9', '1a951079-7005-4507-a09a-ef72e5169d47', '002678c6-dc97-4571-9348-eda1bc888f1e', 'f448f7d0-d094-4167-871c-2d0394fe5e8e'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:20 devstack sudo[84867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:20 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:20 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:20 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "cinder-56b949c4-9e0c-426c-829f-013fc7967ee9-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-56b949c4-9e0c-426c-829f-013fc7967ee9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:21 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-62f48d6e-35c8-4cc3-8fec-2d76e82aa204" returned: 0 in 0.835s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "cinder-quobyte-62f48d6e-35c8-4cc3-8fec-2d76e82aa204" released by "delete_volume" :: held 2.010s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "cinder-quobyte-56b949c4-9e0c-426c-829f-013fc7967ee9" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-quobyte-56b949c4-9e0c-426c-829f-013fc7967ee9" acquired by "delete_volume" :: waited 0.029s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6a01b-9561-4a60-80b9-3dbcd0d14e26]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Created reservations ['a898723d-7514-4791-929d-6326b33ed21f', '5d6c4261-62d2-4729-ae09-c9a736a41dc2', 'd607a8df-fd68-4fe3-bff5-28a6579e70d2', '7b13da1f-ae64-4a10-9d3c-54a97ab24d41'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:21 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:21 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:21 devstack sudo[84873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 Apr 13 09:42:21 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:21 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.974s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Deleted volume successfully. Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b2e7472e-dfa7-41e5-ab80-244ba6a0be73 tempest-VolumeRetypeWithoutMigrationTest-347346809 None] Lock "cinder-6b1fac99-5db9-44ee-8c97-3ccca53570b7-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:21 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 1.209s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Deleted volume successfully. Apr 13 09:42:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e5400b9c-a171-4d70-9092-23f5d30d6a6b tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-1249613b-9f55-4eb7-9dbf-c64de6c86a9f-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:22 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.724s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Deleted volume successfully. Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73a56ed9-9db4-4502-8bfc-6e7127275100 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "cinder-62f48d6e-35c8-4cc3-8fec-2d76e82aa204-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:22 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9" returned: 0 in 1.020s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:22 devstack sudo[84883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9 Apr 13 09:42:22 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Flow 'volume_create_manager' (590b696e-aa09-46e2-968d-e45eafad471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71cacc0-3868-4a24-aa88-ca3a70ad03e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71cacc0-3868-4a24-aa88-ca3a70ad03e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1695099165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e9b138-5bb6-495e-ae49-b6fb42b47edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1e3ce9af4840d683f58f493d4d69af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:23Z,use_quota=True,user_id='7195b8ba99314f36a81a86701ff979dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e89181-29f0-49ef-8d90-18c04ab65e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e89181-29f0-49ef-8d90-18c04ab65e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60532f7-0de2-45e6-8f00-812b0145cbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60532f7-0de2-45e6-8f00-812b0145cbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e9b138-5bb6-495e-ae49-b6fb42b47edb', 'volume_name': 'volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dc72e9-46db-4d11-8630-1713dca4cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dc72e9-46db-4d11-8630-1713dca4cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8057dc-d2bc-4e2a-a0a4-b280d715ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:22 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Volume 49e9b138-5bb6-495e-ae49-b6fb42b47edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb', 'volume_size': 1} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1695099165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e9b138-5bb6-495e-ae49-b6fb42b47edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1e3ce9af4840d683f58f493d4d69af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:23Z,use_quota=True,user_id='7195b8ba99314f36a81a86701ff979dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Creating volume 49e9b138-5bb6-495e-ae49-b6fb42b47edb {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:22 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:23 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb 1073741824 Apr 13 09:42:23 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:23 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-56b949c4-9e0c-426c-829f-013fc7967ee9" returned: 0 in 0.991s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-quobyte-56b949c4-9e0c-426c-829f-013fc7967ee9" released by "delete_volume" :: held 2.084s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Created reservations ['55b98b52-5b0a-47f1-bb2b-539d1a9fddb2', '6bb78dbe-0f45-47f8-9038-d86a6d382b3e', '6bf5e099-c5e5-4821-8c17-96acfde26eb8', 'f6f3c4d3-a9c7-45a5-b5ef-1c19aa86975b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:23 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:23 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:23 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.589s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:23 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Deleted volume successfully. Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-27ff9596-2b6a-4094-a2fb-13b0becc06cb tempest-ServersNegativeTestJSON-1381020278 None] Lock "cinder-56b949c4-9e0c-426c-829f-013fc7967ee9-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:23 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb 1073741824" returned: 0 in 1.026s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:24 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb Apr 13 09:42:24 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:24 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb" returned: 0 in 0.593s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8057dc-d2bc-4e2a-a0a4-b280d715ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4674b1a-0993-4577-bc4a-6f31475e3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:24 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Volume volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb (49e9b138-5bb6-495e-ae49-b6fb42b47edb): created successfully Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4674b1a-0993-4577-bc4a-6f31475e3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Flow 'volume_create_manager' (590b696e-aa09-46e2-968d-e45eafad471d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:24 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7704be0d-ad0c-42c3-91ed-bb2f76794926 tempest-VolumeQuotasAdminTestJSON-1678111677 None] Created volume successfully. Apr 13 09:42:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4499b9c7-bfba-46ba-9ab9-f3bee2df2024 tempest-VolumeQuotasAdminTestJSON-760234182 None] Transfer volume completed successfully. Apr 13 09:42:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Flow 'volume_create_manager' (a5fa4063-6d77-4959-9bd5-4418c5bf281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e8fd29-67ed-4abd-88b6-c7893abde10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e8fd29-67ed-4abd-88b6-c7893abde10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-436860748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a538aa8-2d70-487f-b198-1dc10e3c03db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a11db79691af4a14b7951413158edbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:26Z,use_quota=True,user_id='02566b0a412243cf92ba3abfdcf3ee14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abdded10-5cde-4587-9a93-79c4c0807d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abdded10-5cde-4587-9a93-79c4c0807d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04cd79f-cb8b-44a9-a145-c96336c141ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04cd79f-cb8b-44a9-a145-c96336c141ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a538aa8-2d70-487f-b198-1dc10e3c03db', 'volume_name': 'volume-8a538aa8-2d70-487f-b198-1dc10e3c03db', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de60906b-69b6-434f-98d3-c65b97761552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de60906b-69b6-434f-98d3-c65b97761552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d081e6a6-941a-40bf-8e6a-0379fe1b7d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Volume 8a538aa8-2d70-487f-b198-1dc10e3c03db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a538aa8-2d70-487f-b198-1dc10e3c03db', 'volume_size': 1} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-436860748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a538aa8-2d70-487f-b198-1dc10e3c03db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a11db79691af4a14b7951413158edbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:26Z,use_quota=True,user_id='02566b0a412243cf92ba3abfdcf3ee14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Creating volume 8a538aa8-2d70-487f-b198-1dc10e3c03db {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:26 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:26 devstack sudo[84930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db 1073741824 Apr 13 09:42:26 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Acquiring lock "cinder-49e9b138-5bb6-495e-ae49-b6fb42b47edb-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Lock "cinder-49e9b138-5bb6-495e-ae49-b6fb42b47edb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Acquiring lock "cinder-quobyte-49e9b138-5bb6-495e-ae49-b6fb42b47edb" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Lock "cinder-quobyte-49e9b138-5bb6-495e-ae49-b6fb42b47edb" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4ae0c-5b4e-458f-aed2-a14fdb048ba5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:26 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb Apr 13 09:42:26 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:26 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db 1073741824" returned: 0 in 0.722s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:26 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db Apr 13 09:42:26 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:27 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb" returned: 0 in 0.650s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:27 devstack sudo[84947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb Apr 13 09:42:27 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:27 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db" returned: 0 in 0.549s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d081e6a6-941a-40bf-8e6a-0379fe1b7d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a538aa8-2d70-487f-b198-1dc10e3c03db', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b7366c-5c53-41c4-a41e-451f5c9f0b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Volume volume-8a538aa8-2d70-487f-b198-1dc10e3c03db (8a538aa8-2d70-487f-b198-1dc10e3c03db): created successfully Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b7366c-5c53-41c4-a41e-451f5c9f0b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Flow 'volume_create_manager' (a5fa4063-6d77-4959-9bd5-4418c5bf281e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-170da05f-2135-4df4-8dd0-921d5a81b333 tempest-VolumesServicesTestJSON-961739014 None] Created volume successfully. Apr 13 09:42:27 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-49e9b138-5bb6-495e-ae49-b6fb42b47edb" returned: 0 in 0.423s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Lock "cinder-quobyte-49e9b138-5bb6-495e-ae49-b6fb42b47edb" released by "delete_volume" :: held 1.096s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Created reservations ['1105cfe6-5fa8-47b1-8f05-b8bc55ec47ee', 'e3b73dca-1265-4d70-bfba-7c64370a5f69', '7844cd8e-d7f8-45cd-af08-55b43ab12ccb', '4b7ae72d-a976-4cb5-b40f-678e1c9d7c02'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:27 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:27 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Acquiring lock "cinder-8a538aa8-2d70-487f-b198-1dc10e3c03db-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:28 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.561s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Lock "cinder-8a538aa8-2d70-487f-b198-1dc10e3c03db-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Deleted volume successfully. Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c230fe0-b310-40c0-a0c0-cae5de419f9f tempest-VolumeQuotasAdminTestJSON-373566832 None] Lock "cinder-49e9b138-5bb6-495e-ae49-b6fb42b47edb-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Acquiring lock "cinder-quobyte-8a538aa8-2d70-487f-b198-1dc10e3c03db" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Lock "cinder-quobyte-8a538aa8-2d70-487f-b198-1dc10e3c03db" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[502457d0-9501-4af9-8317-2faf75c5affa]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:28 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db Apr 13 09:42:28 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:29 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db" returned: 0 in 0.739s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:29 devstack sudo[84959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db Apr 13 09:42:29 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:29 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8a538aa8-2d70-487f-b198-1dc10e3c03db" returned: 0 in 0.671s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Lock "cinder-quobyte-8a538aa8-2d70-487f-b198-1dc10e3c03db" released by "delete_volume" :: held 1.440s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:UPDATE=147,cinder:SELECT=125,cinder:INSERT=29,cinder:DELETE=7 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:UPDATE=143,cinder:SELECT=119,cinder:INSERT=35,cinder:DELETE=10 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:42:29 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Created reservations ['1f195bf1-5d52-4520-8d02-1805a6a0a126', '780d22e9-343b-4d63-b5f0-cce3a6e49cd9', '5225e0f3-7ce5-489b-8cdf-104dba2988f1', 'ca0fecba-1279-44cd-b3c2-679a47358aad'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:30 devstack sudo[84965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:30 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Flow 'volume_create_manager' (2cbe5e45-b748-47bf-99ba-b6405e7d23e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04f2e21-4541-4ccf-971a-51bb59a66015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04f2e21-4541-4ccf-971a-51bb59a66015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:30Z,deleted=False,deleted_at=None,display_description='',display_name='a495c9a2-42fb-4f87-99b2-34e092de34fd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab44a2-a78a-48fc-b422-cf8189f37d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2c931c5acb458ab32109fd2edd7111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:30Z,use_quota=True,user_id='337c62f026114aecb828abcd3cce2da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8d0fab-9dfc-468e-83e9-d3c0acba84e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8d0fab-9dfc-468e-83e9-d3c0acba84e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11f613c-6970-4b39-8e6a-6a3defdc7aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11f613c-6970-4b39-8e6a-6a3defdc7aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ab44a2-a78a-48fc-b422-cf8189f37d68', 'volume_name': 'volume-78ab44a2-a78a-48fc-b422-cf8189f37d68', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f800435-2aae-4ef2-9fe5-0077d1f18b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f800435-2aae-4ef2-9fe5-0077d1f18b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b2edf-5167-4b77-8b98-c2b538bc0c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:30 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Volume 78ab44a2-a78a-48fc-b422-cf8189f37d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ab44a2-a78a-48fc-b422-cf8189f37d68', 'volume_size': 1} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:30Z,deleted=False,deleted_at=None,display_description='',display_name='a495c9a2-42fb-4f87-99b2-34e092de34fd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab44a2-a78a-48fc-b422-cf8189f37d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2c931c5acb458ab32109fd2edd7111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:30Z,use_quota=True,user_id='337c62f026114aecb828abcd3cce2da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Creating volume 78ab44a2-a78a-48fc-b422-cf8189f37d68 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:30 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:30 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 1073741824 Apr 13 09:42:30 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:30 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Deleted volume successfully. Apr 13 09:42:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-407a5b55-1e11-493a-a9a8-99912fa8522b tempest-VolumesServicesTestJSON-961739014 None] Lock "cinder-8a538aa8-2d70-487f-b198-1dc10e3c03db-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:31 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 1073741824" returned: 0 in 0.805s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:31 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 Apr 13 09:42:31 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:31 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68" returned: 0 in 0.614s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b2edf-5167-4b77-8b98-c2b538bc0c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ab44a2-a78a-48fc-b422-cf8189f37d68', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896268d6-a91f-4e59-bd1c-2364593091e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:31 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Volume volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 (78ab44a2-a78a-48fc-b422-cf8189f37d68): created successfully Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896268d6-a91f-4e59-bd1c-2364593091e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Flow 'volume_create_manager' (2cbe5e45-b748-47bf-99ba-b6405e7d23e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-70068acb-3b42-4b83-a010-74f17b2e8849 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Created volume successfully. Apr 13 09:42:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea112569-fb95-4b1c-b8fb-1975f719415a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:33 devstack sudo[84989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 Apr 13 09:42:33 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:34 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68" returned: 0 in 1.112s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.125s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66', 'name': 'volume-78ab44a2-a78a-48fc-b422-cf8189f37d68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92d4540d-68a8-4231-99a7-95b7e6009e54', 'enforce_multipath': True} {{(pid=82295) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 09:42:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-c9947c77-356a-4661-9269-12a47c5bbf58 req-009a2788-923e-4749-bcb4-f2d698fdfc97 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] attachment_update completed successfully. Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Flow 'volume_create_manager' (5ac7bc3c-844d-47ad-94f8-0dc5f19e2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d8d985-430d-47f3-bd4b-0d620cf15b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d8d985-430d-47f3-bd4b-0d620cf15b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-82222695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d497ac8-edeb-4cca-b0f2-cc23a6175024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84b6a5d96ac46349b512a7e39c86894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:37Z,use_quota=True,user_id='b71b27ae56044f3aa3ea2a436a0e9fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59fe8866-d289-4fcc-8f86-638012d171f0),volume_type_id=59fe8866-d289-4fcc-8f86-638012d171f0)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae79c1e-de0e-4b1e-a226-adcc04dd3042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae79c1e-de0e-4b1e-a226-adcc04dd3042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7d2f16-a5ad-4f16-8446-b32857400791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7d2f16-a5ad-4f16-8446-b32857400791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d497ac8-edeb-4cca-b0f2-cc23a6175024', 'volume_name': 'volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0cd312-b390-4c55-ad6f-bd11326942b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0cd312-b390-4c55-ad6f-bd11326942b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c46a8d8-abcf-42be-b4ad-9d79d7e570a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:37 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Volume 5d497ac8-edeb-4cca-b0f2-cc23a6175024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024', 'volume_size': 1} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-82222695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d497ac8-edeb-4cca-b0f2-cc23a6175024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84b6a5d96ac46349b512a7e39c86894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:37Z,use_quota=True,user_id='b71b27ae56044f3aa3ea2a436a0e9fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59fe8866-d289-4fcc-8f86-638012d171f0),volume_type_id=59fe8866-d289-4fcc-8f86-638012d171f0)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Creating volume 5d497ac8-edeb-4cca-b0f2-cc23a6175024 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:37 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:37 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 1073741824 Apr 13 09:42:37 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:38 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Flow 'volume_create_manager' (16cddb91-e372-44cc-bcd0-4f4e17d5bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c099bb1-6619-47f7-888f-148fb04a6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 1073741824" returned: 0 in 0.712s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c099bb1-6619-47f7-888f-148fb04a6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1797031465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd03e78-b65d-43ef-a36c-1951a237081b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767809019c5243e694f88ec658c08e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:38Z,use_quota=True,user_id='118df0c7191e46cab760299a0bcefcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4afb078-18df-4299-9aa0-70940c3cabbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4afb078-18df-4299-9aa0-70940c3cabbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1957c799-18e4-498f-b430-73746bfbc71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1957c799-18e4-498f-b430-73746bfbc71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd03e78-b65d-43ef-a36c-1951a237081b', 'volume_name': 'volume-2cd03e78-b65d-43ef-a36c-1951a237081b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08db0d5c-131b-49ef-990c-0f88b5602d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08db0d5c-131b-49ef-990c-0f88b5602d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc03d34-0cba-4aab-947c-e82b8fa5cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:38 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Volume 2cd03e78-b65d-43ef-a36c-1951a237081b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd03e78-b65d-43ef-a36c-1951a237081b', 'volume_size': 1} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:38 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 Apr 13 09:42:38 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:38 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024" returned: 0 in 0.554s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1797031465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd03e78-b65d-43ef-a36c-1951a237081b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767809019c5243e694f88ec658c08e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:38Z,use_quota=True,user_id='118df0c7191e46cab760299a0bcefcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Creating volume 2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:38 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c46a8d8-abcf-42be-b4ad-9d79d7e570a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa5ced-e47f-451b-b42c-162831d886d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:38 devstack sudo[85097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b 1073741824 Apr 13 09:42:38 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:38 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Volume volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 (5d497ac8-edeb-4cca-b0f2-cc23a6175024): created successfully Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa5ced-e47f-451b-b42c-162831d886d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Flow 'volume_create_manager' (5ac7bc3c-844d-47ad-94f8-0dc5f19e2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-914f5f7b-8cb9-467f-9162-93611c3ecdc2 tempest-VolumeTypesAccessTest-1093978078 None] Created volume successfully. Apr 13 09:42:39 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b 1073741824" returned: 0 in 0.602s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:39 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:39 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Acquiring lock "cinder-5d497ac8-edeb-4cca-b0f2-cc23a6175024-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Lock "cinder-5d497ac8-edeb-4cca-b0f2-cc23a6175024-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Acquiring lock "cinder-quobyte-5d497ac8-edeb-4cca-b0f2-cc23a6175024" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Lock "cinder-quobyte-5d497ac8-edeb-4cca-b0f2-cc23a6175024" acquired by "delete_volume" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9229fc4-c19c-4bba-b584-cd9055fcf715]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:39 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 Apr 13 09:42:39 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:39 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 0.647s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc03d34-0cba-4aab-947c-e82b8fa5cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd03e78-b65d-43ef-a36c-1951a237081b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cebec4c-b5e5-4d31-b80c-e10dbb8d185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:40 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Volume volume-2cd03e78-b65d-43ef-a36c-1951a237081b (2cd03e78-b65d-43ef-a36c-1951a237081b): created successfully Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cebec4c-b5e5-4d31-b80c-e10dbb8d185e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Flow 'volume_create_manager' (16cddb91-e372-44cc-bcd0-4f4e17d5bd31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7fa8d9a9-c5b2-4e88-8a17-87f82a0f3f64 tempest-VolumesDeleteCascade-2138284285 None] Created volume successfully. Apr 13 09:42:40 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024" returned: 0 in 0.962s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:40 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024 Apr 13 09:42:40 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:41 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d497ac8-edeb-4cca-b0f2-cc23a6175024" returned: 0 in 0.559s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Lock "cinder-quobyte-5d497ac8-edeb-4cca-b0f2-cc23a6175024" released by "delete_volume" :: held 1.555s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:41 devstack cinder-volume[82295]: WARNING cinder.quota [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-640112003 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-640112003, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:42:41 devstack cinder-volume[82295]: WARNING cinder.quota [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-640112003 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-640112003, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Created reservations ['c6e5c4b7-2585-401d-b2ed-b3b7cfed1957', '7a0b6a51-498d-4101-bd58-11e217c79a9a', '24071a9b-8a79-43ea-8a1c-dc1c64c19475', '2338006f-6d9f-44cd-a23f-12b1033019de'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:41 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:42:41 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Creating offline snapshot 4b60f66f-c38d-4343-9ed5-f8979057a585 of volume 2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ecb162-6bbf-4731-9945-9a572488b8cd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:41 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:41 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.539s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:41 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:42:41 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Deleted volume successfully. Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1dff75c4-e26d-4f18-b200-4f8ea8316510 tempest-VolumeTypesAccessTest-1093978078 None] Lock "cinder-5d497ac8-edeb-4cca-b0f2-cc23a6175024-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:41 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 0.573s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:41 devstack sudo[85461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 1G Apr 13 09:42:41 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:42 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 1G" returned: 0 in 0.990s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:42 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:42 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:43 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.525s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:43 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 is being set with open permissions: ugo+rw Apr 13 09:42:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:43 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:43 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:44 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.594s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:44 devstack sudo[85477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info Apr 13 09:42:44 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:44 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:44 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info is being set with open permissions: ugo+rw Apr 13 09:42:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:44 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info Apr 13 09:42:44 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:45 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.info" returned: 0 in 0.627s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.897s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:45 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-22b2f88b-bc33-483a-8b7d-bed864d2c99f tempest-VolumesDeleteCascade-2138284285 None] Create snapshot completed successfully Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Creating offline snapshot 67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 of volume 2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[09201040-a0fb-4fec-aa50-1b92dad1ae1e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:45 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:45 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:46 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.573s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd03e78-b65d-43ef-a36c-1951a237081b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:42:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:46 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 1G Apr 13 09:42:46 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:46 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 1G" returned: 0 in 0.598s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:46 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 Apr 13 09:42:46 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:47 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" returned: 0 in 0.508s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:47 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 is being set with open permissions: ugo+rw Apr 13 09:42:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:47 devstack sudo[85511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 Apr 13 09:42:47 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:48 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" returned: 0 in 0.577s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2d0f303d-71df-4ed5-af09-a84625db8541 tempest-VolumesDeleteCascade-2138284285 None] Create snapshot completed successfully Apr 13 09:42:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-2cd03e78-b65d-43ef-a36c-1951a237081b-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-2cd03e78-b65d-43ef-a36c-1951a237081b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Performing cascade delete. {{(pid=82295) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-4b60f66f-c38d-4343-9ed5-f8979057a585-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-4b60f66f-c38d-4343-9ed5-f8979057a585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-4b60f66f-c38d-4343-9ed5-f8979057a585" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-4b60f66f-c38d-4343-9ed5-f8979057a585" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Deleting offline snapshot 4b60f66f-c38d-4343-9ed5-f8979057a585 of volume 2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] snapshot_file for this snap is: volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a84146f-ec5c-4bea-b863-29555028927f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:49 devstack sudo[85541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:49 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:49 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.688s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd03e78-b65d-43ef-a36c-1951a237081b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d59f69-8ccf-4d05-8785-fa25cf732c63]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:49 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:49 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:50 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 0.662s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:50 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480eeed-b40b-4c12-bfb5-c15a1160e238]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:50 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 Apr 13 09:42:50 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:51 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" returned: 0 in 0.686s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd03e78-b65d-43ef-a36c-1951a237081b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:42:51 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a557521-94da-404e-af62-f9c3df755685]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:51 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:51 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:52 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.815s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd03e78-b65d-43ef-a36c-1951a237081b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:42:52 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[64397160-6057-4284-a1b4-1a6b8de1691c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:52 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:52 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:52 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 0.684s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:52 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:52 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:53 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.578s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:53 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585 Apr 13 09:42:53 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:53 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.4b60f66f-c38d-4343-9ed5-f8979057a585" returned: 0 in 0.581s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 -F qcow2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:53 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 -F qcow2 Apr 13 09:42:53 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:54 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd03e78-b65d-43ef-a36c-1951a237081b /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 -F qcow2" returned: 0 in 0.809s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-4b60f66f-c38d-4343-9ed5-f8979057a585" released by "_delete_snapshot" :: held 5.638s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" released by "delete_snapshot" :: held 5.649s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Created reservations ['2873252e-18b2-44db-997a-a824a397f0a3', '589324b6-84b5-440f-be66-3b623b47808b', '5f41cd45-2f8c-4bd4-877e-ab4525faac4f', '35616f8b-7df0-4662-bd5c-022469c4527d'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:54 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Delete snapshot completed successfully. Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-4b60f66f-c38d-4343-9ed5-f8979057a585-delete_snapshot" released by "delete_snapshot" :: held 5.807s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-67e1cc19-1ca1-4d73-aeb0-0c83bc299b32-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-67e1cc19-1ca1-4d73-aeb0-0c83bc299b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Deleting offline snapshot 67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 of volume 2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] snapshot_file for this snap is: volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[90771018-0a8b-4ce2-bfd9-4ba67318e025]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:55 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 Apr 13 09:42:55 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:55 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" returned: 0 in 1.026s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd03e78-b65d-43ef-a36c-1951a237081b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:42:55 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e822d3-df78-4591-be7e-45f2e4eaceef]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:56 devstack sudo[85667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:56 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:56 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 1.001s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:57 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 Apr 13 09:42:57 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Flow 'volume_create_manager' (2b3ef5ec-bb89-4690-8103-2576a07163bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8823203-e31a-4e59-91d1-454c9b570fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8823203-e31a-4e59-91d1-454c9b570fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2047560903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df3bc1e-b964-47b3-a2f8-880c0aab785e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f976d22ee48442ccbe4f58fbdf2c619f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:57Z,use_quota=True,user_id='2dc52c3220f24433a00ffac46970ba66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6edd65e-e9f5-4c74-92cc-cbc06ef181a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6edd65e-e9f5-4c74-92cc-cbc06ef181a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd83b496-8551-450a-bea5-15c76d552ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd83b496-8551-450a-bea5-15c76d552ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df3bc1e-b964-47b3-a2f8-880c0aab785e', 'volume_name': 'volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2982e8-e5cc-40ad-a4b1-2797c1046121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2982e8-e5cc-40ad-a4b1-2797c1046121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b15d73-acae-44e7-b2f5-d5f146a0add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:57 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Volume 3df3bc1e-b964-47b3-a2f8-880c0aab785e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e', 'volume_size': 1} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2047560903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df3bc1e-b964-47b3-a2f8-880c0aab785e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f976d22ee48442ccbe4f58fbdf2c619f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:42:57Z,use_quota=True,user_id='2dc52c3220f24433a00ffac46970ba66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Creating volume 3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:42:57 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:57 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e 1073741824 Apr 13 09:42:57 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:57 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" returned: 0 in 0.952s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:57 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32 Apr 13 09:42:57 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:58 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e 1073741824" returned: 0 in 0.978s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:58 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e Apr 13 09:42:58 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:58 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b.67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" returned: 0 in 0.617s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-67e1cc19-1ca1-4d73-aeb0-0c83bc299b32" released by "_delete_snapshot" :: held 3.664s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" released by "delete_snapshot" :: held 3.677s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Created reservations ['627a2d2f-763d-4503-920b-e9bd74bee4b7', '172c8468-1e88-43fa-8575-ba79d53ecd3b', 'f098fe60-d8c0-4587-b583-4fdd4411c140', '72cfc929-3b7e-463f-8a1f-3dcd3e5ac8f2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:42:58 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Delete snapshot completed successfully. Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-67e1cc19-1ca1-4d73-aeb0-0c83bc299b32-delete_snapshot" released by "delete_snapshot" :: held 3.889s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Snapshots deleted, issuing volume delete {{(pid=82295) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8382b-613f-4f7c-9dbd-1c46fe3a0aa6]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:58 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:58 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:59 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e" returned: 0 in 0.715s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b15d73-acae-44e7-b2f5-d5f146a0add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4535a1-cf05-482c-8f20-34876df76278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:42:59 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Volume volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e (3df3bc1e-b964-47b3-a2f8-880c0aab785e): created successfully Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4535a1-cf05-482c-8f20-34876df76278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Flow 'volume_create_manager' (2b3ef5ec-bb89-4690-8103-2576a07163bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:42:59 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-30f0b9c0-2a3e-41cf-bcd8-f307634f5840 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Created volume successfully. Apr 13 09:42:59 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 0.682s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:59 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b Apr 13 09:42:59 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Creating offline snapshot b1e2e00b-5ab9-429b-835e-d7874f78f3bc of volume 3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d2433f-71ab-444a-a2df-30ee125d18e2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:42:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:42:59 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e Apr 13 09:42:59 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:00 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2cd03e78-b65d-43ef-a36c-1951a237081b" returned: 0 in 0.749s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-2cd03e78-b65d-43ef-a36c-1951a237081b" released by "delete_volume" :: held 1.480s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Created reservations ['263ad2a7-b1f1-4bd1-9a99-f30d08e2e3ad', 'fa743d4d-5467-4d0c-91fd-41fc251726ca', '66ef9785-355c-4062-89e7-6bb092cee565', '9b8a85d2-d21f-4546-ada6-eb30dfb3904f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:00 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:00 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:00 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:00 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:00 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e" returned: 0 in 0.911s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:00 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc 1G Apr 13 09:43:00 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:01 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.657s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Deleted volume successfully. Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9140ec80-0043-4f5f-8e15-18c2742b914d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-2cd03e78-b65d-43ef-a36c-1951a237081b-delete_volume" released by "delete_volume" :: held 12.159s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:01 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.954s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:01 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc 1G" returned: 0 in 0.990s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:01 devstack sudo[85790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc Apr 13 09:43:01 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Flow 'volume_create_manager' (bf03813b-971b-4d21-873e-219d4ae229ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5144f497-6735-4b58-9a70-f668a5055492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5144f497-6735-4b58-9a70-f668a5055492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-36022429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f0138c-097f-4b92-a035-6ae571f20b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767809019c5243e694f88ec658c08e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:02Z,use_quota=True,user_id='118df0c7191e46cab760299a0bcefcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d7fef7-9f13-4c6f-aea7-cf00b74847e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d7fef7-9f13-4c6f-aea7-cf00b74847e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1247a7b-e996-415b-a4dc-1a251d488356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1247a7b-e996-415b-a4dc-1a251d488356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f0138c-097f-4b92-a035-6ae571f20b71', 'volume_name': 'volume-70f0138c-097f-4b92-a035-6ae571f20b71', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7c036b-592e-4f05-8274-a78d6d58b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7c036b-592e-4f05-8274-a78d6d58b21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeee3a3-d636-4675-884e-ae3e06c03f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:01 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Volume 70f0138c-097f-4b92-a035-6ae571f20b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f0138c-097f-4b92-a035-6ae571f20b71', 'volume_size': 1} Apr 13 09:43:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:02 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc" returned: 0 in 0.562s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:02 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc is being set with open permissions: ugo+rw Apr 13 09:43:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:02 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc Apr 13 09:43:02 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:02 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc" returned: 0 in 0.452s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:02 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info Apr 13 09:43:02 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:03 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info" returned: 0 in 0.528s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:03 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info is being set with open permissions: ugo+rw Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:03 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info Apr 13 09:43:03 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:03 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.info" returned: 0 in 0.564s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.137s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-36022429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f0138c-097f-4b92-a035-6ae571f20b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767809019c5243e694f88ec658c08e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:02Z,use_quota=True,user_id='118df0c7191e46cab760299a0bcefcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Creating volume 70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:03 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:03 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 1073741824 Apr 13 09:43:03 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bcf8a467-f7da-43e4-bebb-6ce462e7dac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Create snapshot completed successfully Apr 13 09:43:04 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 1073741824" returned: 0 in 0.544s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:04 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:04 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:04 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 0.553s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eeee3a3-d636-4675-884e-ae3e06c03f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f0138c-097f-4b92-a035-6ae571f20b71', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f6c032-9c52-43b6-a0a9-9771ed9883dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:04 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Volume volume-70f0138c-097f-4b92-a035-6ae571f20b71 (70f0138c-097f-4b92-a035-6ae571f20b71): created successfully Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f6c032-9c52-43b6-a0a9-9771ed9883dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Flow 'volume_create_manager' (bf03813b-971b-4d21-873e-219d4ae229ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9141172f-e777-451b-9caf-f8a4d7a2d28e tempest-VolumesDeleteCascade-2138284285 None] Created volume successfully. Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "cinder-b1e2e00b-5ab9-429b-835e-d7874f78f3bc-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-b1e2e00b-5ab9-429b-835e-d7874f78f3bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "cinder-quobyte-3df3bc1e-b964-47b3-a2f8-880c0aab785e" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-quobyte-3df3bc1e-b964-47b3-a2f8-880c0aab785e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "cinder-quobyte-b1e2e00b-5ab9-429b-835e-d7874f78f3bc" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-quobyte-b1e2e00b-5ab9-429b-835e-d7874f78f3bc" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Deleting offline snapshot b1e2e00b-5ab9-429b-835e-d7874f78f3bc of volume 3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] snapshot_file for this snap is: volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae59f7-952e-4ec2-a0de-f296b5ca2db0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:05 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc Apr 13 09:43:05 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:05 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc" returned: 0 in 0.656s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1aa5c-b41d-4300-bba4-05dfb051a379]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:06 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e Apr 13 09:43:06 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Creating offline snapshot 3b6391e9-3ea1-4e6b-914a-69fe93bba706 of volume 70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d41a85b-965a-476f-9e77-f4029387b750]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:06 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:06 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:06 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e" returned: 0 in 0.770s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:06 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 0.548s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:06 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc Apr 13 09:43:06 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:06 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 1G Apr 13 09:43:06 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:07 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc" returned: 0 in 0.555s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:07 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc Apr 13 09:43:07 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:07 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 1G" returned: 0 in 0.642s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f0138c-097f-4b92-a035-6ae571f20b71 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:07 devstack sudo[85847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f0138c-097f-4b92-a035-6ae571f20b71 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 Apr 13 09:43:07 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:07 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e.b1e2e00b-5ab9-429b-835e-d7874f78f3bc" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-quobyte-b1e2e00b-5ab9-429b-835e-d7874f78f3bc" released by "_delete_snapshot" :: held 2.528s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-quobyte-3df3bc1e-b964-47b3-a2f8-880c0aab785e" released by "delete_snapshot" :: held 2.545s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Created reservations ['259ea180-d003-4d11-9ca3-b444fd83a50d', '6321f515-3b69-4a14-842b-7449f8889134', 'bcd7d6d6-530c-4473-9aef-57a44217368e', '10e9921e-fcb1-45b4-aa6c-e4cbd359cc68'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Delete snapshot completed successfully. Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e3890a59-a014-4e21-835e-6b5a43ee512c tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-b1e2e00b-5ab9-429b-835e-d7874f78f3bc-delete_snapshot" released by "delete_snapshot" :: held 2.679s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:07 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f0138c-097f-4b92-a035-6ae571f20b71 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706" returned: 0 in 0.602s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:07 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 is being set with open permissions: ugo+rw Apr 13 09:43:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:08 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 Apr 13 09:43:08 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "cinder-3df3bc1e-b964-47b3-a2f8-880c0aab785e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-3df3bc1e-b964-47b3-a2f8-880c0aab785e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "cinder-quobyte-3df3bc1e-b964-47b3-a2f8-880c0aab785e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-quobyte-3df3bc1e-b964-47b3-a2f8-880c0aab785e" acquired by "delete_volume" :: waited 0.019s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a4e581-dd74-4389-a77f-c4ffaed644b0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:08 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706" returned: 0 in 0.578s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:08 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info Apr 13 09:43:08 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:08 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e Apr 13 09:43:08 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:09 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info" returned: 0 in 0.601s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:09 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info is being set with open permissions: ugo+rw Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:09 devstack sudo[85867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info Apr 13 09:43:09 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:09 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e" returned: 0 in 0.702s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:09 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e Apr 13 09:43:09 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:09 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3df3bc1e-b964-47b3-a2f8-880c0aab785e" returned: 0 in 0.600s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:09 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.info" returned: 0 in 0.680s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.756s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-quobyte-3df3bc1e-b964-47b3-a2f8-880c0aab785e" released by "delete_volume" :: held 1.363s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f3587750-5363-4d33-9e38-c263815e954c tempest-VolumesDeleteCascade-2138284285 None] Create snapshot completed successfully Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Created reservations ['44bb03f5-e496-48c9-a1fb-ea3f9c6821d5', '8123c5dd-21a9-4560-b6a9-0fcaec3427bf', '0cd2508c-5d9c-4293-877a-96d312151a42', '31868e97-6adb-44a8-b326-a2d73d946948'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:10 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:10 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:10 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.472s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:10 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Deleted volume successfully. Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-739164a5-b061-4fdf-89ab-e36b86213aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-2087105464 None] Lock "cinder-3df3bc1e-b964-47b3-a2f8-880c0aab785e-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Flow 'volume_create_manager' (10a6e129-26bb-474f-b771-41563015c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b514e-8100-4c55-821d-32f77677137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b514e-8100-4c55-821d-32f77677137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-110912388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ccaa5d-706f-4d8a-b697-59debf277b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='767809019c5243e694f88ec658c08e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b6391e9-3ea1-4e6b-914a-69fe93bba706,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:11Z,use_quota=True,user_id='118df0c7191e46cab760299a0bcefcd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc05e64-b6e0-4880-b675-365bd723ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc05e64-b6e0-4880-b675-365bd723ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e05d4ed-24ad-47e6-a3c3-ab8b27c75d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e05d4ed-24ad-47e6-a3c3-ab8b27c75d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47ccaa5d-706f-4d8a-b697-59debf277b08', 'volume_name': 'volume-47ccaa5d-706f-4d8a-b697-59debf277b08', 'volume_size': 1, 'snapshot_id': '3b6391e9-3ea1-4e6b-914a-69fe93bba706'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5109dc0-e629-41c0-adeb-c21ed6241ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5109dc0-e629-41c0-adeb-c21ed6241ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be88f059-21b6-487c-bea4-93a2bedb6ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:10 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Volume 47ccaa5d-706f-4d8a-b697-59debf277b08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47ccaa5d-706f-4d8a-b697-59debf277b08', 'volume_size': 1, 'snapshot_id': '3b6391e9-3ea1-4e6b-914a-69fe93bba706'} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-3b6391e9-3ea1-4e6b-914a-69fe93bba706-47ccaa5d-706f-4d8a-b697-59debf277b08" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-3b6391e9-3ea1-4e6b-914a-69fe93bba706-47ccaa5d-706f-4d8a-b697-59debf277b08" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Creating volume 47ccaa5d-706f-4d8a-b697-59debf277b08 from snapshot 3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-47ccaa5d-706f-4d8a-b697-59debf277b08" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-47ccaa5d-706f-4d8a-b697-59debf277b08" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] snapshot: 3b6391e9-3ea1-4e6b-914a-69fe93bba706, volume: 47ccaa5d-706f-4d8a-b697-59debf277b08, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bab91f-e338-40a1-983a-db6a7974c2d4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:10 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 Apr 13 09:43:10 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:11 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70f0138c-097f-4b92-a035-6ae571f20b71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[85adb43c-f1d7-4942-bb0b-44f79a7138b5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:11 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:11 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:11 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 0.598s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:43:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:11 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 Apr 13 09:43:11 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:14 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08" returned: 0 in 2.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:14 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdbf1a9-ad4d-4280-ad24-946d81853665]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:14 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:14 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:15 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 1.100s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71, size 1024.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:43:15 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Converted 1024.00 MB image at 412.48 MB/s Apr 13 09:43:15 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 is being set with open permissions: ugo+rw Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:15 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 Apr 13 09:43:15 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:15 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08" returned: 0 in 0.475s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-47ccaa5d-706f-4d8a-b697-59debf277b08" released by "_copy_volume_from_snapshot" :: held 5.213s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-3b6391e9-3ea1-4e6b-914a-69fe93bba706-47ccaa5d-706f-4d8a-b697-59debf277b08" released by "_create_volume_from_snapshot" :: held 5.228s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.236s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be88f059-21b6-487c-bea4-93a2bedb6ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ccaa5d-706f-4d8a-b697-59debf277b08', 'volume_size': 1, 'snapshot_id': '3b6391e9-3ea1-4e6b-914a-69fe93bba706'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eff3e6b-6e64-47f7-a42c-1b054c4b9b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:15 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Volume volume-47ccaa5d-706f-4d8a-b697-59debf277b08 (47ccaa5d-706f-4d8a-b697-59debf277b08): created successfully Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eff3e6b-6e64-47f7-a42c-1b054c4b9b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Flow 'volume_create_manager' (10a6e129-26bb-474f-b771-41563015c987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:15 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-950db6d1-84ae-423f-bf1d-3b5884ab22d6 tempest-VolumesDeleteCascade-2138284285 None] Created volume successfully. Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-70f0138c-097f-4b92-a035-6ae571f20b71-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-70f0138c-097f-4b92-a035-6ae571f20b71-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Performing cascade delete. {{(pid=82295) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-3b6391e9-3ea1-4e6b-914a-69fe93bba706-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-3b6391e9-3ea1-4e6b-914a-69fe93bba706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-70f0138c-097f-4b92-a035-6ae571f20b71" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-70f0138c-097f-4b92-a035-6ae571f20b71" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-3b6391e9-3ea1-4e6b-914a-69fe93bba706" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-3b6391e9-3ea1-4e6b-914a-69fe93bba706" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Deleting offline snapshot 3b6391e9-3ea1-4e6b-914a-69fe93bba706 of volume 70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] snapshot_file for this snap is: volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa9c372-3113-4c93-a399-e3b53e1ee8ad]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:16 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 Apr 13 09:43:16 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:16 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706" returned: 0 in 0.577s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70f0138c-097f-4b92-a035-6ae571f20b71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c358c74-8da3-4a73-901c-452455c613b0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:17 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:17 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:17 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 0.635s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:17 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 Apr 13 09:43:17 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:18 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706" returned: 0 in 0.545s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:18 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706 Apr 13 09:43:18 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:18 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71.3b6391e9-3ea1-4e6b-914a-69fe93bba706" returned: 0 in 0.485s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-3b6391e9-3ea1-4e6b-914a-69fe93bba706" released by "_delete_snapshot" :: held 2.349s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-70f0138c-097f-4b92-a035-6ae571f20b71" released by "delete_snapshot" :: held 2.374s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Created reservations ['f53473be-7ace-4fcf-bec2-12ee36c89e91', 'b61d74a2-a0a0-4215-892e-c73ff905c124', 'b2c76ab6-81ef-4dce-98c3-684528299bb6', '5fd2d841-40b5-4bf2-92b3-43f3610d7534'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Delete snapshot completed successfully. Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-3b6391e9-3ea1-4e6b-914a-69fe93bba706-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Snapshots deleted, issuing volume delete {{(pid=82295) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-70f0138c-097f-4b92-a035-6ae571f20b71" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-70f0138c-097f-4b92-a035-6ae571f20b71" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c1206f-eaab-48b4-bc3a-167962e9e1e2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:18 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:18 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:19 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 0.791s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:19 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71 Apr 13 09:43:19 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:20 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-70f0138c-097f-4b92-a035-6ae571f20b71" returned: 0 in 0.538s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-70f0138c-097f-4b92-a035-6ae571f20b71" released by "delete_volume" :: held 1.419s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Created reservations ['a2d78d47-1dea-481f-a674-ba3dfbb34341', '39d1ce87-da79-4057-87b6-9aa1da92b384', 'a019a2c6-83aa-47fe-9007-9f62f2c8da31', 'cca67b86-b979-4ff9-8d28-b763a88562a9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:20 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:20 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-47ccaa5d-706f-4d8a-b697-59debf277b08-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-47ccaa5d-706f-4d8a-b697-59debf277b08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "cinder-quobyte-47ccaa5d-706f-4d8a-b697-59debf277b08" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-47ccaa5d-706f-4d8a-b697-59debf277b08" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f56a2f-65fc-41a7-80a2-31be4fecc922]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:20 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.642s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:20 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Deleted volume successfully. Apr 13 09:43:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb2fb398-bad3-4462-ac68-6cfe4f2fec3d tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-70f0138c-097f-4b92-a035-6ae571f20b71-delete_volume" released by "delete_volume" :: held 4.814s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:21 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 Apr 13 09:43:21 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:21 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08" returned: 0 in 1.111s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:21 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08 Apr 13 09:43:21 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:22 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-47ccaa5d-706f-4d8a-b697-59debf277b08" returned: 0 in 0.616s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-quobyte-47ccaa5d-706f-4d8a-b697-59debf277b08" released by "delete_volume" :: held 1.761s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Created reservations ['06df0ced-ea37-4d3a-85c1-8885dd49b7cf', '59e36edd-b922-4474-a42c-baa1f2291f9c', '83c415a3-f502-4337-a4e7-1d758c4bad38', '4eae65bc-c199-4bc7-9e1d-48f6abdbf1b8'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:22 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:22 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:23 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 1.079s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:23 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:23 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Deleted volume successfully. Apr 13 09:43:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-393f9e5e-cda0-4c98-90ff-d1087194e63c tempest-VolumesDeleteCascade-2138284285 None] Lock "cinder-47ccaa5d-706f-4d8a-b697-59debf277b08-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Flow 'volume_create_manager' (b615443a-c4b6-47ef-a688-c30a23713ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ae87fb-a1bd-4087-bb7c-9ba8d2090ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ae87fb-a1bd-4087-bb7c-9ba8d2090ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1435719001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d7e04b-69d2-43b2-b292-6095f6734d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981cd0d061b5471aa20c321cb469aa96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:25Z,use_quota=True,user_id='104a6ebfa35040ad9385524461869a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337ae9e4-efc1-4218-aa72-452c14cf6fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337ae9e4-efc1-4218-aa72-452c14cf6fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034d4625-17d4-44fd-ab0d-e13b4efad3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034d4625-17d4-44fd-ab0d-e13b4efad3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d7e04b-69d2-43b2-b292-6095f6734d6c', 'volume_name': 'volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9b874d-c614-4496-9ebd-a7d5a1e790ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9b874d-c614-4496-9ebd-a7d5a1e790ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d995697d-ea40-4db1-b7cd-3a66260dbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Volume e0d7e04b-69d2-43b2-b292-6095f6734d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c', 'volume_size': 1} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1435719001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d7e04b-69d2-43b2-b292-6095f6734d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='981cd0d061b5471aa20c321cb469aa96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:25Z,use_quota=True,user_id='104a6ebfa35040ad9385524461869a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Creating volume e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:25 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:25 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c 1073741824 Apr 13 09:43:25 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (4e927508-aef7-4dc6-a3ff-a41819aa8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22763ac-5ba5-4e9e-ba7d-674d0cda7dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22763ac-5ba5-4e9e-ba7d-674d0cda7dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1644261181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045c6628-f470-4031-821c-cdffde8478d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:25Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343fa9a0-cab9-4a95-ab4b-61543c3c5091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343fa9a0-cab9-4a95-ab4b-61543c3c5091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca110d94-a659-49ee-9cd6-d945917fe5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca110d94-a659-49ee-9cd6-d945917fe5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045c6628-f470-4031-821c-cdffde8478d2', 'volume_name': 'volume-045c6628-f470-4031-821c-cdffde8478d2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae21484c-7be0-42e0-8970-4c7a5c507421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae21484c-7be0-42e0-8970-4c7a5c507421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a99ae3e-f1e7-44ea-8250-46c540655883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Volume 045c6628-f470-4031-821c-cdffde8478d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045c6628-f470-4031-821c-cdffde8478d2', 'volume_size': 1} Apr 13 09:43:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:26 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c 1073741824" returned: 0 in 1.374s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:26 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c Apr 13 09:43:26 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:27 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c" returned: 0 in 0.583s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.741s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1644261181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045c6628-f470-4031-821c-cdffde8478d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:25Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Creating volume 045c6628-f470-4031-821c-cdffde8478d2 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:27 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d995697d-ea40-4db1-b7cd-3a66260dbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:27 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 1073741824 Apr 13 09:43:27 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d9a9b4-0279-43bb-ba5e-9a7a620f7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Volume volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c (e0d7e04b-69d2-43b2-b292-6095f6734d6c): created successfully Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d9a9b4-0279-43bb-ba5e-9a7a620f7c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Flow 'volume_create_manager' (b615443a-c4b6-47ef-a688-c30a23713ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a36bc7ae-f3a0-4482-9c8f-2165251553f6 tempest-SnapshotMetadataTestJSON-1715351704 None] Created volume successfully. Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Flow 'volume_create_manager' (4caceb45-66b1-40e6-8e00-0130578e5ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a304f-d3cd-408c-8595-c179bfbeddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195a304f-d3cd-408c-8595-c179bfbeddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767975647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e0f9ee-99e8-485e-bbe0-94e6e0e65f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59a4e65701945e19a2f9f707d9e0b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:28Z,use_quota=True,user_id='2579a074f15c48928b28138099478f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef8b3ad-76a5-4dec-b265-1c4b4efc04a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef8b3ad-76a5-4dec-b265-1c4b4efc04a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6388bd-0396-4013-b7c7-0d9bce3e698f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6388bd-0396-4013-b7c7-0d9bce3e698f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e0f9ee-99e8-485e-bbe0-94e6e0e65f64', 'volume_name': 'volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc78cc5-7e00-4021-b566-91cd60a4406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc78cc5-7e00-4021-b566-91cd60a4406c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5150a44d-27eb-4602-86dd-ce80b0a359ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Volume 58e0f9ee-99e8-485e-bbe0-94e6e0e65f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64', 'volume_size': 1} Apr 13 09:43:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:28 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 1073741824" returned: 0 in 0.829s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:28 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 Apr 13 09:43:28 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:28 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2" returned: 0 in 0.489s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1767975647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e0f9ee-99e8-485e-bbe0-94e6e0e65f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59a4e65701945e19a2f9f707d9e0b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:28Z,use_quota=True,user_id='2579a074f15c48928b28138099478f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Creating volume 58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:28 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a99ae3e-f1e7-44ea-8250-46c540655883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045c6628-f470-4031-821c-cdffde8478d2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d95040-e153-4199-af64-e3afef574258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:28 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 1073741824 Apr 13 09:43:28 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:28 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Volume volume-045c6628-f470-4031-821c-cdffde8478d2 (045c6628-f470-4031-821c-cdffde8478d2): created successfully Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d95040-e153-4199-af64-e3afef574258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (4e927508-aef7-4dc6-a3ff-a41819aa8126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c7801596-fc18-4ff2-8691-15bee8b6903e tempest-VolumesActionsTest-640027547 None] Created volume successfully. Apr 13 09:43:29 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 1073741824" returned: 0 in 0.732s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:29 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 Apr 13 09:43:29 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c32e0d3-cfee-409b-a2b7-94b9725c61aa tempest-VolumesActionsTest-640027547 None] Acquiring lock "cinder-045c6628-f470-4031-821c-cdffde8478d2" by "attach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c32e0d3-cfee-409b-a2b7-94b9725c61aa tempest-VolumesActionsTest-640027547 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2" acquired by "attach_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9c32e0d3-cfee-409b-a2b7-94b9725c61aa tempest-VolumesActionsTest-640027547 None] Attaching volume 045c6628-f470-4031-821c-cdffde8478d2 to instance c12eb8a6-5eb2-4287-854b-a2a2437d6012 at mountpoint /dev/vdb on host None. Apr 13 09:43:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9c32e0d3-cfee-409b-a2b7-94b9725c61aa tempest-VolumesActionsTest-640027547 None] Attach volume completed successfully. Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c32e0d3-cfee-409b-a2b7-94b9725c61aa tempest-VolumesActionsTest-640027547 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2" released by "attach_volume" :: held 0.070s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:29 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64" returned: 0 in 0.538s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.360s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5150a44d-27eb-4602-86dd-ce80b0a359ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26faf3b1-69f7-4e2b-8034-1c2fccfb9a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Creating offline snapshot 2369d69f-3605-4533-aa26-6a4446fc8e6b of volume e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:43:29 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Volume volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 (58e0f9ee-99e8-485e-bbe0-94e6e0e65f64): created successfully Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26faf3b1-69f7-4e2b-8034-1c2fccfb9a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Flow 'volume_create_manager' (4caceb45-66b1-40e6-8e00-0130578e5ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fecbfa1-e090-4456-94c5-ac395518259c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a494ca01-eaad-4693-ab15-070224833c6d tempest-VolumesTransfersV355Test-432612484 None] Created volume successfully. Apr 13 09:43:29 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c Apr 13 09:43:29 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:30 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c" returned: 0 in 0.681s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:30 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b 1G Apr 13 09:43:30 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:30 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=89,cinder:UPDATE=104,cinder:INSERT=26,cinder:DELETE=11 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:43:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6b2c58be-4456-4c61-8f64-20ed3ae90c19 tempest-VolumesTransfersV355Test-1338876210 None] Transfer volume completed successfully. Apr 13 09:43:30 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=95,cinder:INSERT=27,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:43:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a69a7dff-6c98-4b19-8c73-7b94a685d815 tempest-VolumesActionsTest-1933079568 None] Terminate volume connection completed successfully. Apr 13 09:43:31 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b 1G" returned: 0 in 0.589s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:31 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b Apr 13 09:43:31 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a69a7dff-6c98-4b19-8c73-7b94a685d815 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-detach_volume" by "detach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a69a7dff-6c98-4b19-8c73-7b94a685d815 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a69a7dff-6c98-4b19-8c73-7b94a685d815 tempest-VolumesActionsTest-1933079568 None] Detaching volume 045c6628-f470-4031-821c-cdffde8478d2 from instance c12eb8a6-5eb2-4287-854b-a2a2437d6012. Apr 13 09:43:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a69a7dff-6c98-4b19-8c73-7b94a685d815 tempest-VolumesActionsTest-1933079568 None] Detach volume completed successfully. Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a69a7dff-6c98-4b19-8c73-7b94a685d815 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Acquiring lock "cinder-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Acquiring lock "cinder-quobyte-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-quobyte-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaf1748-d456-4d32-aae9-1e835c9dc009]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:31 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 Apr 13 09:43:31 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-98f67a2e-d4b3-40c7-a348-300cd623708b tempest-VolumesActionsTest-640027547 None] Acquiring lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-detach_volume" by "detach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-98f67a2e-d4b3-40c7-a348-300cd623708b tempest-VolumesActionsTest-640027547 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-98f67a2e-d4b3-40c7-a348-300cd623708b tempest-VolumesActionsTest-640027547 None] Volume detach called, but volume not attached. Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-98f67a2e-d4b3-40c7-a348-300cd623708b tempest-VolumesActionsTest-640027547 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:31 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b" returned: 0 in 0.785s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:31 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b is being set with open permissions: ugo+rw Apr 13 09:43:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:32 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b Apr 13 09:43:32 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:32 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64" returned: 0 in 0.634s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:32 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64 Apr 13 09:43:32 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:32 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:32 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info Apr 13 09:43:32 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Acquiring lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Acquiring lock "cinder-quobyte-045c6628-f470-4031-821c-cdffde8478d2" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Lock "cinder-quobyte-045c6628-f470-4031-821c-cdffde8478d2" acquired by "delete_volume" :: waited 0.027s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded4ed5-a979-43c5-bdd6-d7a675d00169]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:32 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 Apr 13 09:43:32 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:33 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info" returned: 0 in 0.718s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:33 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info is being set with open permissions: ugo+rw Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:33 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info Apr 13 09:43:33 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:33 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64" returned: 0 in 1.036s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-quobyte-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64" released by "delete_volume" :: held 1.749s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Created reservations ['1e6e43d4-8c21-4a6e-bc80-28eb70afe6f7', '2a81ef82-28d3-4bc0-aaa1-de47590b9202', '41e0ad55-0bbc-4e15-be79-43667b2a9dd8', '2fa9b986-a030-45ca-927f-1575f469d05e'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:33 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2" returned: 0 in 0.857s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:33 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:33 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:33 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2 Apr 13 09:43:33 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:34 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.info" returned: 0 in 0.912s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.319s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b307b542-ffea-44b8-bad9-4fad1a858fa8 tempest-SnapshotMetadataTestJSON-1715351704 None] Create snapshot completed successfully Apr 13 09:43:34 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.994s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Deleted volume successfully. Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9f09a1d2-6e64-40a4-bf55-192352cb2282 tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-58e0f9ee-99e8-485e-bbe0-94e6e0e65f64-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Flow 'volume_create_manager' (e862d4b9-4ebf-48dc-8d48-1670e91d56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bc94c2-5e4f-4661-bb7c-8ecb03db71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bc94c2-5e4f-4661-bb7c-8ecb03db71dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-527157417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109a0d8f-d333-454e-b8da-3159f76f3954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59a4e65701945e19a2f9f707d9e0b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:35Z,use_quota=True,user_id='2579a074f15c48928b28138099478f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174809ac-d9eb-4913-8740-9c2229f9ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174809ac-d9eb-4913-8740-9c2229f9ba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d05b7c-ff90-44ad-a41c-9200018c8d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d05b7c-ff90-44ad-a41c-9200018c8d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109a0d8f-d333-454e-b8da-3159f76f3954', 'volume_name': 'volume-109a0d8f-d333-454e-b8da-3159f76f3954', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be2f9b4-a711-4c69-bb52-e2a3a2b73dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be2f9b4-a711-4c69-bb52-e2a3a2b73dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adbcceb-d33a-44a4-b1c7-6a4c325adf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:35 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Volume 109a0d8f-d333-454e-b8da-3159f76f3954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109a0d8f-d333-454e-b8da-3159f76f3954', 'volume_size': 1} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-527157417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109a0d8f-d333-454e-b8da-3159f76f3954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59a4e65701945e19a2f9f707d9e0b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:35Z,use_quota=True,user_id='2579a074f15c48928b28138099478f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Creating volume 109a0d8f-d333-454e-b8da-3159f76f3954 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:35 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:35 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 1073741824 Apr 13 09:43:35 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:35 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-045c6628-f470-4031-821c-cdffde8478d2" returned: 0 in 1.769s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Lock "cinder-quobyte-045c6628-f470-4031-821c-cdffde8478d2" released by "delete_volume" :: held 2.659s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Created reservations ['2ac29392-aba9-4712-bd66-7f53e1adfedd', 'db003b15-4ead-4eb4-94f3-9f19a80dc202', 'e8f498ee-a2d7-4eab-9ed4-fa8e5950f868', '889e528b-c580-4693-81fa-62acaa7144c2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:35 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:35 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:36 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.528s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Deleted volume successfully. Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5844864e-f8df-4e26-b7a8-1bdbeb8ff091 tempest-VolumesActionsTest-640027547 None] Lock "cinder-045c6628-f470-4031-821c-cdffde8478d2-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Flow 'volume_create_manager' (3d3dbfec-a6be-4c3c-8725-088dde011f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0efa16b-ee21-4c40-bdf9-e3813182cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0efa16b-ee21-4c40-bdf9-e3813182cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:36Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ea4827-6c2c-45ff-88ae-eeac19b70e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2c931c5acb458ab32109fd2edd7111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:37Z,use_quota=True,user_id='337c62f026114aecb828abcd3cce2da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d08c44b-17f2-4191-afe4-bddf3f3c8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d08c44b-17f2-4191-afe4-bddf3f3c8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74253f9c-a394-4ba7-a7aa-3efa87597a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.image.glance [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Creating Keystone auth plugin from conf {{(pid=82295) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "cinder-2369d69f-3605-4533-aa26-6a4446fc8e6b-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:36 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 1073741824" returned: 0 in 1.875s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-2369d69f-3605-4533-aa26-6a4446fc8e6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "cinder-quobyte-e0d7e04b-69d2-43b2-b292-6095f6734d6c" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-quobyte-e0d7e04b-69d2-43b2-b292-6095f6734d6c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "cinder-quobyte-2369d69f-3605-4533-aa26-6a4446fc8e6b" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-quobyte-2369d69f-3605-4533-aa26-6a4446fc8e6b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Deleting offline snapshot 2369d69f-3605-4533-aa26-6a4446fc8e6b of volume e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:43:37 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 Apr 13 09:43:37 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] snapshot_file for this snap is: volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1471fb66-0bdd-4892-b8a3-d4c8ddd253eb]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:37 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b Apr 13 09:43:37 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74253f9c-a394-4ba7-a7aa-3efa87597a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8ea4827-6c2c-45ff-88ae-eeac19b70e90', 'volume_name': 'volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2fee19-b3bb-4c6c-a239-225405a5ff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2fee19-b3bb-4c6c-a239-225405a5ff75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725af1b1-c5f5-4f39-9005-d864fb6ca52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:37 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Volume a8ea4827-6c2c-45ff-88ae-eeac19b70e90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Trying to clone a8ea4827-6c2c-45ff-88ae-eeac19b70e90 from image 168ef6f7-3a65-468d-bd46-416aedea31b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]). {{(pid=82295) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 09:43:37 devstack cinder-volume[82295]: INFO cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Image download 20.69 MB at 20.69 MB/s Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecac0b7-20e6-4488-9fde-858f7b3c0927]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:37 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954" returned: 0 in 0.868s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] <== create_volume: return (2785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.791s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adbcceb-d33a-44a4-b1c7-6a4c325adf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109a0d8f-d333-454e-b8da-3159f76f3954', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d457f120-fd58-4c88-b7c5-a58ca11ad658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:37 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Volume volume-109a0d8f-d333-454e-b8da-3159f76f3954 (109a0d8f-d333-454e-b8da-3159f76f3954): created successfully Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d457f120-fd58-4c88-b7c5-a58ca11ad658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Flow 'volume_create_manager' (e862d4b9-4ebf-48dc-8d48-1670e91d56e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-18790854-2bd0-4924-bc40-1a7b7a260122 tempest-VolumesTransfersV355Test-432612484 None] Created volume successfully. Apr 13 09:43:38 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD Apr 13 09:43:38 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:38 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b" returned: 0 in 1.195s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[084c9fce-5a9d-405b-a6f4-d3e0fa64bf74]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:38 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c Apr 13 09:43:38 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:38 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 is fetched for user 337c62f026114aecb828abcd3cce2da5. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Acquiring lock "cinder-109a0d8f-d333-454e-b8da-3159f76f3954-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c5e3c-d3db-48cf-8948-6503303e5c18]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-109a0d8f-d333-454e-b8da-3159f76f3954-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Acquiring lock "cinder-quobyte-109a0d8f-d333-454e-b8da-3159f76f3954" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-quobyte-109a0d8f-d333-454e-b8da-3159f76f3954" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f47624-6bcc-48ec-a099-ba876314542d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:38 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD Apr 13 09:43:38 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:39 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 Apr 13 09:43:39 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:39 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c" returned: 0 in 0.920s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:39 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b Apr 13 09:43:39 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:39 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD" returned: 0 in 0.698s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:36Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ea4827-6c2c-45ff-88ae-eeac19b70e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2c931c5acb458ab32109fd2edd7111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:37Z,use_quota=True,user_id='337c62f026114aecb828abcd3cce2da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Creating volume a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:39 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:39 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 1073741824 Apr 13 09:43:39 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:40 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954" returned: 0 in 1.201s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:40 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b" returned: 0 in 0.931s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:40 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954 Apr 13 09:43:40 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b Apr 13 09:43:40 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:40 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:40 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 1073741824" returned: 0 in 0.834s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:40 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:43:40 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:40 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c.2369d69f-3605-4533-aa26-6a4446fc8e6b" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:40 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-109a0d8f-d333-454e-b8da-3159f76f3954" returned: 0 in 0.547s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-quobyte-2369d69f-3605-4533-aa26-6a4446fc8e6b" released by "_delete_snapshot" :: held 3.632s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-quobyte-109a0d8f-d333-454e-b8da-3159f76f3954" released by "delete_volume" :: held 1.776s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-quobyte-e0d7e04b-69d2-43b2-b292-6095f6734d6c" released by "delete_snapshot" :: held 3.661s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Created reservations ['d2f21877-d63f-46e6-b810-ee72c86b8876', '72d54d3b-9562-4e22-827b-4648fa0f2be4', '5aaa138f-def8-494e-9557-0c4271c3cb08', 'c6ff5d44-6394-4c28-b6f9-fc94f627bf01'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Created reservations ['b3554a48-ec32-45ad-a0ac-eeff4b5ef828', '452701d5-fa4e-4c01-988a-e7dd7e1e8e00', '206374b8-2f0e-4094-8ac0-aa70ed285a24', '06b2460e-e979-4aae-b810-33b8583ea28d'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Delete snapshot completed successfully. Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a0f642e4-f463-4659-b4af-f33aa68acba0 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-2369d69f-3605-4533-aa26-6a4446fc8e6b-delete_snapshot" released by "delete_snapshot" :: held 3.795s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:40 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:40 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:40 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:40 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Attempting download of 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume a8ea4827-6c2c-45ff-88ae-eeac19b70e90. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80610ef-1d97-4acf-967b-6fecba5ae008]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:41 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk Apr 13 09:43:41 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "cinder-e0d7e04b-69d2-43b2-b292-6095f6734d6c-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-e0d7e04b-69d2-43b2-b292-6095f6734d6c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "cinder-quobyte-e0d7e04b-69d2-43b2-b292-6095f6734d6c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:41 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.554s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-quobyte-e0d7e04b-69d2-43b2-b292-6095f6734d6c" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[01669c27-d815-4119-9601-0d651f60c05d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:41 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Deleted volume successfully. Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1174ffa1-214c-4e93-9503-f250f4f987be tempest-VolumesTransfersV355Test-613792647 None] Lock "cinder-109a0d8f-d333-454e-b8da-3159f76f3954-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:41 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c Apr 13 09:43:41 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:41 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk" returned: 0 in 0.779s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:41 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk Apr 13 09:43:41 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:41 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c" returned: 0 in 0.586s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:41 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c Apr 13 09:43:41 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:42 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk" returned: 1 in 0.897s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_tfncimlk' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e8d64e-7673-4782-8a1e-7c9e1692901c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:42 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e0d7e04b-69d2-43b2-b292-6095f6734d6c" returned: 0 in 0.790s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-quobyte-e0d7e04b-69d2-43b2-b292-6095f6734d6c" released by "delete_volume" :: held 1.421s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Created reservations ['c3402b39-9948-4afa-88bf-92e6dbbf8d1d', '590955a8-691f-437a-b16c-ba2c6e198889', '7f6e59e1-161f-4d60-bde5-a5db0ce23630', '0891f2cc-665c-4eee-8cf7-28f2ffc85b3e'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:42 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD Apr 13 09:43:42 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:42 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:42 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:43 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD" returned: 0 in 0.821s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:43 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] 168ef6f7-3a65-468d-bd46-416aedea31b3 was qcow2, converting to raw {{(pid=82295) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 09:43:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:43 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:43:43 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:43 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.734s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:43 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:43 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Deleted volume successfully. Apr 13 09:43:43 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a2fd2dd2-5c51-4d17-9e2a-3740911c57d6 tempest-SnapshotMetadataTestJSON-1715351704 None] Lock "cinder-e0d7e04b-69d2-43b2-b292-6095f6734d6c-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:45 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 0 in 1.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_2mh8v9b6devstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:43:45 devstack cinder-volume[82295]: INFO cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Converted 112.00 MB image at 74.01 MB/s Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:45 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 1G Apr 13 09:43:45 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (06b9b1eb-1bb5-48c2-9801-cb2095bcdd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aadc23a-fd04-47d0-9281-8480961f2a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aadc23a-fd04-47d0-9281-8480961f2a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1365832198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe1d632-960a-413c-8d9f-e518657bedc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:45Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e113812-a2c8-4e1e-a284-ddb1791e973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e113812-a2c8-4e1e-a284-ddb1791e973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604a3750-d12f-4d92-b7a8-3e402a8e9ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604a3750-d12f-4d92-b7a8-3e402a8e9ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe1d632-960a-413c-8d9f-e518657bedc1', 'volume_name': 'volume-ffe1d632-960a-413c-8d9f-e518657bedc1', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198cfa4e-a5f3-40c7-a0ac-9d18e6c21224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198cfa4e-a5f3-40c7-a0ac-9d18e6c21224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6fa153-a1b6-429e-a88d-2aebf6150308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:45 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Volume ffe1d632-960a-413c-8d9f-e518657bedc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe1d632-960a-413c-8d9f-e518657bedc1', 'volume_size': 1} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1365832198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe1d632-960a-413c-8d9f-e518657bedc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:45Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Creating volume ffe1d632-960a-413c-8d9f-e518657bedc1 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:45 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:45 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 1073741824 Apr 13 09:43:45 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:45 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 1G" returned: 0 in 0.757s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dc9e9a-61df-4d9b-ad83-cafeb813ede9]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:46 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:43:46 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:46 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 1073741824" returned: 0 in 0.830s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:46 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 Apr 13 09:43:46 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:46 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 0 in 0.991s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:46 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1" returned: 0 in 0.854s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6fa153-a1b6-429e-a88d-2aebf6150308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe1d632-960a-413c-8d9f-e518657bedc1', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc1d510-e493-4180-95a3-c096acf0b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Volume volume-ffe1d632-960a-413c-8d9f-e518657bedc1 (ffe1d632-960a-413c-8d9f-e518657bedc1): created successfully Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc1d510-e493-4180-95a3-c096acf0b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:46 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:43:46 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (06b9b1eb-1bb5-48c2-9801-cb2095bcdd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b28d22d5-7968-4ae4-b3fe-ca9b907296e4 tempest-VolumesActionsTest-640027547 None] Created volume successfully. Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Flow 'volume_create_manager' (79af35f9-5b28-4774-8642-0d712c64e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0a570d-c02f-4a95-8005-09e819857f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-ffe1d632-960a-413c-8d9f-e518657bedc1-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0a570d-c02f-4a95-8005-09e819857f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-336694611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2287a677-7d88-464d-81a4-8d1e15f34b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45367b1ff74a4619a641882c45364395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:47Z,use_quota=True,user_id='86d0d48756b7450180710486090a47b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b374a4f3-b502-45b4-bd1a-5ee18e075038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b374a4f3-b502-45b4-bd1a-5ee18e075038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d3fe82-e08f-42a9-a6b8-05e63a62a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d3fe82-e08f-42a9-a6b8-05e63a62a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2287a677-7d88-464d-81a4-8d1e15f34b82', 'volume_name': 'volume-2287a677-7d88-464d-81a4-8d1e15f34b82', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a38c82c-19ff-425a-b313-d3dfdc3acaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a38c82c-19ff-425a-b313-d3dfdc3acaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2858e966-fc6b-46e9-a79f-0521dfed3a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:47 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Volume 2287a677-7d88-464d-81a4-8d1e15f34b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2287a677-7d88-464d-81a4-8d1e15f34b82', 'volume_size': 1} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-336694611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2287a677-7d88-464d-81a4-8d1e15f34b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45367b1ff74a4619a641882c45364395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:47Z,use_quota=True,user_id='86d0d48756b7450180710486090a47b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Creating volume 2287a677-7d88-464d-81a4-8d1e15f34b82 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:47 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Lock "cinder-ffe1d632-960a-413c-8d9f-e518657bedc1-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:47 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 1073741824 Apr 13 09:43:47 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-quobyte-ffe1d632-960a-413c-8d9f-e518657bedc1" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-ffe1d632-960a-413c-8d9f-e518657bedc1" acquired by "delete_volume" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b4f222-0037-4056-8fa8-bc6b6eaeb4cc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:47 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 1 in 0.900s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Downloaded image 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume a8ea4827-6c2c-45ff-88ae-eeac19b70e90 successfully. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 for user 337c62f026114aecb828abcd3cce2da5 is deleted. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Marking volume a8ea4827-6c2c-45ff-88ae-eeac19b70e90 as bootable. {{(pid=82295) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Copying metadata from image 168ef6f7-3a65-468d-bd46-416aedea31b3 to a8ea4827-6c2c-45ff-88ae-eeac19b70e90. {{(pid=82295) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Creating volume glance metadata for volume a8ea4827-6c2c-45ff-88ae-eeac19b70e90 backed by image 168ef6f7-3a65-468d-bd46-416aedea31b3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82295) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 09:43:47 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 Apr 13 09:43:47 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725af1b1-c5f5-4f39-9005-d864fb6ca52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459220c4-29e8-4ea7-a9b4-f0c5cc189104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:47 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Volume volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 (a8ea4827-6c2c-45ff-88ae-eeac19b70e90): created successfully Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459220c4-29e8-4ea7-a9b4-f0c5cc189104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Flow 'volume_create_manager' (3d3dbfec-a6be-4c3c-8725-088dde011f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-041e45d3-7fa8-4095-90f7-e69eafaa760a tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Created volume successfully. Apr 13 09:43:48 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 1073741824" returned: 0 in 0.674s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:48 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 Apr 13 09:43:48 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:48 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1" returned: 0 in 0.654s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:48 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1 Apr 13 09:43:48 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:49 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82" returned: 0 in 0.677s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2858e966-fc6b-46e9-a79f-0521dfed3a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2287a677-7d88-464d-81a4-8d1e15f34b82', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4908f10-6371-4a6d-88c3-cfa4eff9c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Volume volume-2287a677-7d88-464d-81a4-8d1e15f34b82 (2287a677-7d88-464d-81a4-8d1e15f34b82): created successfully Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4908f10-6371-4a6d-88c3-cfa4eff9c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Flow 'volume_create_manager' (79af35f9-5b28-4774-8642-0d712c64e015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ce1d9877-6cd6-4f55-a3b8-64ac026f48fc tempest-VolumesTransfersV357Test-821148772 None] Created volume successfully. Apr 13 09:43:49 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ffe1d632-960a-413c-8d9f-e518657bedc1" returned: 0 in 0.704s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-ffe1d632-960a-413c-8d9f-e518657bedc1" released by "delete_volume" :: held 1.383s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Created reservations ['dc58368c-a8f1-4709-88e7-e9666df4e0c3', 'e04cdf13-c922-4877-aba5-91c2a5aed83d', '33cb4e8b-7ab8-45e0-b8d9-8dd8e25c7290', '47570151-52c0-4148-a77d-a61c9a7a5894'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[986266e5-acc3-47bc-b470-229ba5918515]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:49 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:49 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:49 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:43:49 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Flow 'volume_create_manager' (fd81d989-5bc6-444f-ba4a-866e5562ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c9384c-1b23-447a-b225-595ef3d57389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c9384c-1b23-447a-b225-595ef3d57389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1447370277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cc4939-3b54-4bd9-a47f-317b597eca38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3d2f26ebb443cfaed1101957d71210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:49Z,use_quota=True,user_id='a200a5d088b8441cb13b3878c18893b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749819ba-65a2-4e7f-ad81-a35b397678ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749819ba-65a2-4e7f-ad81-a35b397678ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4af1aae-a414-41a2-b1d4-6ddac36dd4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4af1aae-a414-41a2-b1d4-6ddac36dd4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cc4939-3b54-4bd9-a47f-317b597eca38', 'volume_name': 'volume-42cc4939-3b54-4bd9-a47f-317b597eca38', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a86978f-60b5-4dfd-82bf-8c5a8939f853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a86978f-60b5-4dfd-82bf-8c5a8939f853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeb9048-07ec-4325-bd74-029582fb0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Volume 42cc4939-3b54-4bd9-a47f-317b597eca38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cc4939-3b54-4bd9-a47f-317b597eca38', 'volume_size': 1} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:49 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.505s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Deleted volume successfully. Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9cd22b7b-73be-40b1-89b7-d6aae308be8b tempest-VolumesActionsTest-1933079568 None] Lock "cinder-ffe1d632-960a-413c-8d9f-e518657bedc1-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:49 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 0 in 0.623s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:49 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:43:49 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4e9e7a40-26e1-433e-ab79-62e86b7451d2 tempest-VolumesTransfersV357Test-2057787911 None] Transfer volume completed successfully. Apr 13 09:43:50 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 1 in 0.510s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.163s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1447370277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cc4939-3b54-4bd9-a47f-317b597eca38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3d2f26ebb443cfaed1101957d71210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:49Z,use_quota=True,user_id='a200a5d088b8441cb13b3878c18893b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Creating volume 42cc4939-3b54-4bd9-a47f-317b597eca38 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:50 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:50 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 1073741824 Apr 13 09:43:50 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66', 'name': 'volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfb08a0e-81d7-4687-be6c-b5016e498420', 'enforce_multipath': True} {{(pid=82295) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 09:43:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-0345df53-30ab-457a-a7ff-7b5c6222bd49 req-03597d51-b8e0-4084-aea8-6d2cfbb41fe4 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] attachment_update completed successfully. Apr 13 09:43:50 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 1073741824" returned: 0 in 0.546s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:50 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 Apr 13 09:43:50 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Acquiring lock "cinder-2287a677-7d88-464d-81a4-8d1e15f34b82-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-2287a677-7d88-464d-81a4-8d1e15f34b82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (7544e480-f37a-4995-8252-594bdafea342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4223cce8-8211-4315-9e65-b7bb8fbfeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4223cce8-8211-4315-9e65-b7bb8fbfeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741001106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73efc0b0-9621-4675-bebb-d5c27c894a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:51Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ca5529-b637-4926-8a30-05273b37d504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ca5529-b637-4926-8a30-05273b37d504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8dd7f4-675b-497c-9204-d0607737093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8dd7f4-675b-497c-9204-d0607737093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73efc0b0-9621-4675-bebb-d5c27c894a34', 'volume_name': 'volume-73efc0b0-9621-4675-bebb-d5c27c894a34', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9881a908-7011-469e-aa9c-ad5761c8bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9881a908-7011-469e-aa9c-ad5761c8bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec56e2c0-9b8e-4aca-a9eb-e9d48b968a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Volume 73efc0b0-9621-4675-bebb-d5c27c894a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73efc0b0-9621-4675-bebb-d5c27c894a34', 'volume_size': 1} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Acquiring lock "cinder-quobyte-2287a677-7d88-464d-81a4-8d1e15f34b82" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-quobyte-2287a677-7d88-464d-81a4-8d1e15f34b82" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f267c-c4e9-4c3e-8194-251663a3a192]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:51 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 Apr 13 09:43:51 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:51 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38" returned: 0 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741001106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73efc0b0-9621-4675-bebb-d5c27c894a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:51Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Creating volume 73efc0b0-9621-4675-bebb-d5c27c894a34 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:51 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfeb9048-07ec-4325-bd74-029582fb0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cc4939-3b54-4bd9-a47f-317b597eca38', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:51 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 1073741824 Apr 13 09:43:51 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555be7e4-eb05-430e-8987-932e3f860a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Volume volume-42cc4939-3b54-4bd9-a47f-317b597eca38 (42cc4939-3b54-4bd9-a47f-317b597eca38): created successfully Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555be7e4-eb05-430e-8987-932e3f860a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Flow 'volume_create_manager' (fd81d989-5bc6-444f-ba4a-866e5562ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:51 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-67ded74a-ed84-4662-8fff-1a6f3eb84005 tempest-AbsoluteLimitsTests-146056503 None] Created volume successfully. Apr 13 09:43:51 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82" returned: 0 in 0.567s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:51 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82 Apr 13 09:43:51 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Acquiring lock "cinder-42cc4939-3b54-4bd9-a47f-317b597eca38-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Lock "cinder-42cc4939-3b54-4bd9-a47f-317b597eca38-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Acquiring lock "cinder-quobyte-42cc4939-3b54-4bd9-a47f-317b597eca38" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Lock "cinder-quobyte-42cc4939-3b54-4bd9-a47f-317b597eca38" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2531b7f-c27f-450d-865a-6184b6d9e2e9]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:52 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 1073741824" returned: 0 in 0.686s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:52 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 Apr 13 09:43:52 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:52 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2287a677-7d88-464d-81a4-8d1e15f34b82" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:52 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 Apr 13 09:43:52 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-quobyte-2287a677-7d88-464d-81a4-8d1e15f34b82" released by "delete_volume" :: held 1.071s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Created reservations ['27d572e8-9b97-45a5-9478-7948047c397e', '5aad3749-4b1d-4335-a541-c0798b812434', '9f1f27b5-2a72-496f-9fa2-a6d2a7f7dded', '714bf2c8-b663-4a1d-a092-6ed34e159976'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:52 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:52 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:52 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34" returned: 0 in 0.455s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:52 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38" returned: 0 in 0.555s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec56e2c0-9b8e-4aca-a9eb-e9d48b968a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73efc0b0-9621-4675-bebb-d5c27c894a34', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abfde70-5307-48f6-b9d4-ea1ec6bf5a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:52 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38 Apr 13 09:43:52 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:52 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Volume volume-73efc0b0-9621-4675-bebb-d5c27c894a34 (73efc0b0-9621-4675-bebb-d5c27c894a34): created successfully Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abfde70-5307-48f6-b9d4-ea1ec6bf5a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (7544e480-f37a-4995-8252-594bdafea342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:52 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7effbf0f-1997-4db0-a20e-7889dcfcaf06 tempest-VolumesActionsTest-640027547 None] Created volume successfully. Apr 13 09:43:52 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.439s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:52 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Deleted volume successfully. Apr 13 09:43:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ada1b96-5ed0-4ba6-95ef-e2ad8538e916 tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-2287a677-7d88-464d-81a4-8d1e15f34b82-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:53 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-42cc4939-3b54-4bd9-a47f-317b597eca38" returned: 0 in 0.423s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Lock "cinder-quobyte-42cc4939-3b54-4bd9-a47f-317b597eca38" released by "delete_volume" :: held 1.033s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Created reservations ['f59872d4-9580-41bd-8a5b-6184d6bd74d7', 'a463adc4-0e78-43da-a874-c5fca5268f23', '4e2bcc37-55d5-45a1-b450-b26864c76c2a', '0e16c30f-e9e4-41b8-a370-71f682b5ba7a'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:53 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:53 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-73efc0b0-9621-4675-bebb-d5c27c894a34-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-73efc0b0-9621-4675-bebb-d5c27c894a34-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-quobyte-73efc0b0-9621-4675-bebb-d5c27c894a34" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-73efc0b0-9621-4675-bebb-d5c27c894a34" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d9f0d-ce67-402a-8d49-4b95af94c163]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:53 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 Apr 13 09:43:53 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Flow 'volume_create_manager' (09db1288-1956-4437-bfea-4515a231d8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0123231-8055-4426-8b37-4ab6dcb4ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0123231-8055-4426-8b37-4ab6dcb4ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1035896389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c107e653-b639-4950-98fd-0247e0d5b08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45367b1ff74a4619a641882c45364395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:53Z,use_quota=True,user_id='86d0d48756b7450180710486090a47b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8ffb78-5512-4f62-9c59-f89ba56dd0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8ffb78-5512-4f62-9c59-f89ba56dd0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b36fbe-a696-42c6-807f-2e2958a42693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b36fbe-a696-42c6-807f-2e2958a42693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c107e653-b639-4950-98fd-0247e0d5b08e', 'volume_name': 'volume-c107e653-b639-4950-98fd-0247e0d5b08e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f807abb1-3334-42ed-a43c-aef81858cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f807abb1-3334-42ed-a43c-aef81858cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807b229b-cfc4-4d55-960d-7c4b4c47ad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:53 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Volume c107e653-b639-4950-98fd-0247e0d5b08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c107e653-b639-4950-98fd-0247e0d5b08e', 'volume_size': 1} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1035896389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c107e653-b639-4950-98fd-0247e0d5b08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45367b1ff74a4619a641882c45364395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:53Z,use_quota=True,user_id='86d0d48756b7450180710486090a47b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Creating volume c107e653-b639-4950-98fd-0247e0d5b08e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:53 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:53 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e 1073741824 Apr 13 09:43:53 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:53 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Deleted volume successfully. Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a399c82-251f-414b-ac4f-cee7b66333d4 tempest-AbsoluteLimitsTests-146056503 None] Lock "cinder-42cc4939-3b54-4bd9-a47f-317b597eca38-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:53 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34" returned: 0 in 0.549s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:53 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34 Apr 13 09:43:53 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:54 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e 1073741824" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:54 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e Apr 13 09:43:54 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:54 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-73efc0b0-9621-4675-bebb-d5c27c894a34" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-73efc0b0-9621-4675-bebb-d5c27c894a34" released by "delete_volume" :: held 1.098s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Created reservations ['46d5453b-0bc4-43a2-b613-4aeed5af3599', '4333c657-74d6-4684-865e-fff5cc27faaf', '08916b6c-8914-4f5a-a078-15d39a029e40', '8435cbfa-6184-4247-8dac-35bef647f944'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:54 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:54 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:54 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807b229b-cfc4-4d55-960d-7c4b4c47ad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c107e653-b639-4950-98fd-0247e0d5b08e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a304bb-db1d-4cc8-89b8-ce8d51808ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:54 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Volume volume-c107e653-b639-4950-98fd-0247e0d5b08e (c107e653-b639-4950-98fd-0247e0d5b08e): created successfully Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a304bb-db1d-4cc8-89b8-ce8d51808ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Flow 'volume_create_manager' (09db1288-1956-4437-bfea-4515a231d8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:54 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4236a3e9-5a23-4c6a-a084-968054cf85fb tempest-VolumesTransfersV357Test-821148772 None] Created volume successfully. Apr 13 09:43:55 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.600s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:55 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Deleted volume successfully. Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4d4fcbd9-6cd1-4d38-a474-b962a5d71170 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-73efc0b0-9621-4675-bebb-d5c27c894a34-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Acquiring lock "cinder-c107e653-b639-4950-98fd-0247e0d5b08e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-c107e653-b639-4950-98fd-0247e0d5b08e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Acquiring lock "cinder-quobyte-c107e653-b639-4950-98fd-0247e0d5b08e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-quobyte-c107e653-b639-4950-98fd-0247e0d5b08e" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab2292e-fb83-4b9f-8c2e-a82be13a8920]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (f074a0fe-8091-44b9-816c-5c8d4c392389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcb0088-c203-4d54-9f2d-e4209813da7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:56 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e Apr 13 09:43:56 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcb0088-c203-4d54-9f2d-e4209813da7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928604507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce54da7f-f531-4d9c-ac30-02fd9ad90a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:56Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d4ccc7-853e-4bb6-a009-11bcf23b01e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d4ccc7-853e-4bb6-a009-11bcf23b01e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23452df5-1f30-4646-9825-100f8f38091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23452df5-1f30-4646-9825-100f8f38091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce54da7f-f531-4d9c-ac30-02fd9ad90a93', 'volume_name': 'volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957ca70e-6f9c-4992-b3b3-3738d2f043af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957ca70e-6f9c-4992-b3b3-3738d2f043af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc71201e-034f-4448-afc6-5d3d167be885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:56 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Volume ce54da7f-f531-4d9c-ac30-02fd9ad90a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93', 'volume_size': 1} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928604507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce54da7f-f531-4d9c-ac30-02fd9ad90a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:56Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Creating volume ce54da7f-f531-4d9c-ac30-02fd9ad90a93 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:56 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:56 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 1073741824 Apr 13 09:43:56 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:57 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e" returned: 0 in 1.092s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:57 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e Apr 13 09:43:57 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:57 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 1073741824" returned: 0 in 1.035s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:57 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 Apr 13 09:43:57 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:57 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c107e653-b639-4950-98fd-0247e0d5b08e" returned: 0 in 0.950s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-quobyte-c107e653-b639-4950-98fd-0247e0d5b08e" released by "delete_volume" :: held 2.103s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:58 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93" returned: 0 in 0.893s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc71201e-034f-4448-afc6-5d3d167be885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8e8d69-c450-4db4-8082-fa6eb629d3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:58 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Volume volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 (ce54da7f-f531-4d9c-ac30-02fd9ad90a93): created successfully Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8e8d69-c450-4db4-8082-fa6eb629d3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (f074a0fe-8091-44b9-816c-5c8d4c392389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Created reservations ['4825240e-dd7c-4b1f-b2b0-32057dc6e496', '0b04a667-c360-4916-b59c-78473c9570fa', '2caee7e8-4567-48b9-b901-e6c6932708a9', '7f7dc099-9379-41a0-bf16-6251c4ddce9a'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:43:58 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1648955d-0e78-417f-9559-88b17223dc9a tempest-VolumesActionsTest-640027547 None] Created volume successfully. Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:58 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:43:58 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:58 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.603s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:43:58 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Deleted volume successfully. Apr 13 09:43:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d0890c25-a46f-4700-b5c6-d205b9093ffe tempest-VolumesTransfersV357Test-1283442525 None] Lock "cinder-c107e653-b639-4950-98fd-0247e0d5b08e-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Flow 'volume_create_manager' (47b85ab9-dc2e-4758-8807-892bf76533fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04eecc4-720d-41f9-a0dc-770c1586b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04eecc4-720d-41f9-a0dc-770c1586b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2065165403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00a90b9-fc22-4195-844a-652380c92ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b478c74f89140c4a53a6e0886dd77a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:59Z,use_quota=True,user_id='9e6bba76b93446f0ab6cb49870685d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f5dd7-6805-41aa-9564-8fe4f030ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f5dd7-6805-41aa-9564-8fe4f030ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421329de-e2f5-4da9-a7a7-ec05529ffabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421329de-e2f5-4da9-a7a7-ec05529ffabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00a90b9-fc22-4195-844a-652380c92ef4', 'volume_name': 'volume-d00a90b9-fc22-4195-844a-652380c92ef4', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79c87a0-0e5b-41a4-bef6-15c9ae7084bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79c87a0-0e5b-41a4-bef6-15c9ae7084bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e3766c-00d9-4cbb-a6a8-4405128bbf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:43:59 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Volume d00a90b9-fc22-4195-844a-652380c92ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00a90b9-fc22-4195-844a-652380c92ef4', 'volume_size': 1} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2065165403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00a90b9-fc22-4195-844a-652380c92ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b478c74f89140c4a53a6e0886dd77a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:43:59Z,use_quota=True,user_id='9e6bba76b93446f0ab6cb49870685d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Creating volume d00a90b9-fc22-4195-844a-652380c92ef4 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:43:59 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-ce54da7f-f531-4d9c-ac30-02fd9ad90a93-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:59 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 1073741824 Apr 13 09:43:59 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-ce54da7f-f531-4d9c-ac30-02fd9ad90a93-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-quobyte-ce54da7f-f531-4d9c-ac30-02fd9ad90a93" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-ce54da7f-f531-4d9c-ac30-02fd9ad90a93" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7604ae8b-973c-4894-a2f6-ad44645fd811]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:43:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:43:59 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 Apr 13 09:43:59 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:00 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93" returned: 0 in 0.619s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:00 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 1073741824" returned: 0 in 0.743s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:00 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93 Apr 13 09:44:00 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:00 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 Apr 13 09:44:00 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:00 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:00 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:01 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ce54da7f-f531-4d9c-ac30-02fd9ad90a93" returned: 0 in 0.793s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-ce54da7f-f531-4d9c-ac30-02fd9ad90a93" released by "delete_volume" :: held 1.464s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:01 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4" returned: 0 in 0.788s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e3766c-00d9-4cbb-a6a8-4405128bbf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00a90b9-fc22-4195-844a-652380c92ef4', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ee518a-caa1-4513-816f-5c2a486e71bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:01 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Volume volume-d00a90b9-fc22-4195-844a-652380c92ef4 (d00a90b9-fc22-4195-844a-652380c92ef4): created successfully Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ee518a-caa1-4513-816f-5c2a486e71bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:01 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Flow 'volume_create_manager' (47b85ab9-dc2e-4758-8807-892bf76533fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.668s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-82c316f4-28cf-427a-981b-05c0af93d8b5 tempest-VolumesTransfersTest-798727539 None] Created volume successfully. Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Created reservations ['b87bbb2b-6942-425b-bd1c-ffa77a9f3bf4', '84ec006a-76eb-49bd-90dd-76322ce92931', '83560b3c-1981-42af-8339-229d72d7fa9b', 'f3172e16-1174-4874-92b1-dda4ce7371fc'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:01 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:01 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:01 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.485s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Deleted volume successfully. Apr 13 09:44:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd2fb0ac-749f-4e96-9e1f-5ba211cba390 tempest-VolumesActionsTest-1933079568 None] Lock "cinder-ce54da7f-f531-4d9c-ac30-02fd9ad90a93-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (e2f1172a-fe47-490a-a9a7-b65d741ffa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe68e1a-b040-4345-b91c-c63d538bad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe68e1a-b040-4345-b91c-c63d538bad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1638689015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cdc329-9be8-41a2-abc7-b455269e0f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:02Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7bd59f-c72b-4900-9776-322d766020fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7bd59f-c72b-4900-9776-322d766020fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98579259-7e6d-48f8-961f-bfbb9a069b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98579259-7e6d-48f8-961f-bfbb9a069b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cdc329-9be8-41a2-abc7-b455269e0f35', 'volume_name': 'volume-84cdc329-9be8-41a2-abc7-b455269e0f35', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9843c0-86db-4f94-a0a0-cf69bd976f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9843c0-86db-4f94-a0a0-cf69bd976f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1737514f-08d9-4af7-a456-4d99c6e924c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:02 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Volume 84cdc329-9be8-41a2-abc7-b455269e0f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cdc329-9be8-41a2-abc7-b455269e0f35', 'volume_size': 1} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1638689015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cdc329-9be8-41a2-abc7-b455269e0f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:02Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Creating volume 84cdc329-9be8-41a2-abc7-b455269e0f35 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:02 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:02 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 1073741824 Apr 13 09:44:02 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:02 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-254c6123-72fa-4b2a-b1f8-b00a0f6f4d5c tempest-VolumesTransfersTest-383806151 None] Transfer volume completed successfully. Apr 13 09:44:02 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 1073741824" returned: 0 in 0.619s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:02 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 Apr 13 09:44:02 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Acquiring lock "cinder-d00a90b9-fc22-4195-844a-652380c92ef4-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-d00a90b9-fc22-4195-844a-652380c92ef4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Acquiring lock "cinder-quobyte-d00a90b9-fc22-4195-844a-652380c92ef4" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-quobyte-d00a90b9-fc22-4195-844a-652380c92ef4" acquired by "delete_volume" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c9f36-582b-425d-9b01-49e90131f398]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:03 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 Apr 13 09:44:03 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:03 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35" returned: 0 in 0.712s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1737514f-08d9-4af7-a456-4d99c6e924c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cdc329-9be8-41a2-abc7-b455269e0f35', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429695e1-4590-44ef-8483-928d2d0e63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:03 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Volume volume-84cdc329-9be8-41a2-abc7-b455269e0f35 (84cdc329-9be8-41a2-abc7-b455269e0f35): created successfully Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429695e1-4590-44ef-8483-928d2d0e63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (e2f1172a-fe47-490a-a9a7-b65d741ffa32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-18c30973-8935-436d-811b-2a1eea5b2c4f tempest-VolumesActionsTest-640027547 None] Created volume successfully. Apr 13 09:44:03 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4" returned: 0 in 0.560s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:03 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4 Apr 13 09:44:03 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-84cdc329-9be8-41a2-abc7-b455269e0f35-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Lock "cinder-84cdc329-9be8-41a2-abc7-b455269e0f35-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Acquiring lock "cinder-quobyte-84cdc329-9be8-41a2-abc7-b455269e0f35" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-84cdc329-9be8-41a2-abc7-b455269e0f35" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8950a1cf-ab01-440e-b083-80fd51fe80dd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:04 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d00a90b9-fc22-4195-844a-652380c92ef4" returned: 0 in 0.752s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-quobyte-d00a90b9-fc22-4195-844a-652380c92ef4" released by "delete_volume" :: held 1.336s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:04 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 Apr 13 09:44:04 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Created reservations ['734f6878-4648-4e8f-9481-26532c0eacaa', '633d4b5c-665c-4a87-81a4-70e065808387', '3cd2ff91-481a-45e5-8e8c-78e6145ba330', '1a09daf2-b277-497a-8392-3f4ad51dc52a'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:04 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:04 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:05 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35" returned: 0 in 0.702s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:05 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35 Apr 13 09:44:05 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:05 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:05 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Deleted volume successfully. Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-57dc3f05-6c8d-4f0b-9345-01af0fd434b4 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-d00a90b9-fc22-4195-844a-652380c92ef4-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:05 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-84cdc329-9be8-41a2-abc7-b455269e0f35" returned: 0 in 0.533s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Lock "cinder-quobyte-84cdc329-9be8-41a2-abc7-b455269e0f35" released by "delete_volume" :: held 1.263s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Created reservations ['d777202e-5b9f-4d81-ae15-cc26adc46e79', '4321c1d5-8910-4e68-a809-4ec4b8fd90c2', 'b076b6f2-cfe7-422d-b2cf-ee8a6369465f', '072c117d-34ec-46e3-aab6-a422055a5ca1'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Flow 'volume_create_manager' (1038f9ad-a293-4108-91c9-7531075963a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8a4233-3faf-4e83-8c65-ebc10c60eb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8a4233-3faf-4e83-8c65-ebc10c60eb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1826407158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ef95ad-948e-4151-918e-df6f55bd8a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b478c74f89140c4a53a6e0886dd77a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:06Z,use_quota=True,user_id='9e6bba76b93446f0ab6cb49870685d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f54f2e2-0bc7-45d3-8702-e86283b97f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f54f2e2-0bc7-45d3-8702-e86283b97f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aefd30b-0b76-4ced-9b36-85eb5cd01212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aefd30b-0b76-4ced-9b36-85eb5cd01212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ef95ad-948e-4151-918e-df6f55bd8a86', 'volume_name': 'volume-97ef95ad-948e-4151-918e-df6f55bd8a86', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed4613-c942-45ab-8fee-27a21ce204bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed4613-c942-45ab-8fee-27a21ce204bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152f0f35-925c-423f-8a11-8d59fa988519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:05 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Volume 97ef95ad-948e-4151-918e-df6f55bd8a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ef95ad-948e-4151-918e-df6f55bd8a86', 'volume_size': 1} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1826407158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ef95ad-948e-4151-918e-df6f55bd8a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b478c74f89140c4a53a6e0886dd77a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:06Z,use_quota=True,user_id='9e6bba76b93446f0ab6cb49870685d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Creating volume 97ef95ad-948e-4151-918e-df6f55bd8a86 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:05 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:05 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 1073741824 Apr 13 09:44:05 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:05 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:05 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:06 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 1073741824" returned: 0 in 0.527s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:06 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:06 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Deleted volume successfully. Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-c97cea0e-d9f9-4ed1-8e15-a35f9cb60b3e tempest-VolumesActionsTest-1933079568 None] Lock "cinder-84cdc329-9be8-41a2-abc7-b455269e0f35-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:06 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 Apr 13 09:44:06 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (a22e9bda-474f-48f1-8606-292fe954cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587b3c3d-0502-4211-90db-fec8e10354c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587b3c3d-0502-4211-90db-fec8e10354c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127389422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b7c244-65b0-4742-b415-6a7378fdd12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:07Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a30f68-2301-435b-b9da-3eb5486a9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a30f68-2301-435b-b9da-3eb5486a9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8ecee6-127e-4efd-8dcf-9b5d9f3f9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8ecee6-127e-4efd-8dcf-9b5d9f3f9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b7c244-65b0-4742-b415-6a7378fdd12a', 'volume_name': 'volume-40b7c244-65b0-4742-b415-6a7378fdd12a', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67aded9-67d3-49be-b913-d8be9a1a5e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67aded9-67d3-49be-b913-d8be9a1a5e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dd64b5-fbf2-4b3a-8b3c-2911317168fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:06 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Volume 40b7c244-65b0-4742-b415-6a7378fdd12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b7c244-65b0-4742-b415-6a7378fdd12a', 'volume_size': 1} Apr 13 09:44:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:07 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86" returned: 0 in 0.509s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.027s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2127389422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b7c244-65b0-4742-b415-6a7378fdd12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6265daae49fb4d4dbd08c93e98efbd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:07Z,use_quota=True,user_id='e5970617464d4f77b1c2fa00c6d56d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Creating volume 40b7c244-65b0-4742-b415-6a7378fdd12a {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:07 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152f0f35-925c-423f-8a11-8d59fa988519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ef95ad-948e-4151-918e-df6f55bd8a86', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2de63ee-2321-482a-af4f-6b36bc3cfc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:07 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a 1073741824 Apr 13 09:44:07 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:07 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Volume volume-97ef95ad-948e-4151-918e-df6f55bd8a86 (97ef95ad-948e-4151-918e-df6f55bd8a86): created successfully Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2de63ee-2321-482a-af4f-6b36bc3cfc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Flow 'volume_create_manager' (1038f9ad-a293-4108-91c9-7531075963a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-55423348-762b-4cfa-a974-b07262d79cce tempest-VolumesTransfersTest-798727539 None] Created volume successfully. Apr 13 09:44:07 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a 1073741824" returned: 0 in 0.577s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:07 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a Apr 13 09:44:07 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Acquiring lock "cinder-97ef95ad-948e-4151-918e-df6f55bd8a86-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:08 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-97ef95ad-948e-4151-918e-df6f55bd8a86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a" returned: 0 in 0.552s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dd64b5-fbf2-4b3a-8b3c-2911317168fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b7c244-65b0-4742-b415-6a7378fdd12a', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41008d1-4112-4637-8999-f66cc1cfc869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:08 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Volume volume-40b7c244-65b0-4742-b415-6a7378fdd12a (40b7c244-65b0-4742-b415-6a7378fdd12a): created successfully Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41008d1-4112-4637-8999-f66cc1cfc869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Flow 'volume_create_manager' (a22e9bda-474f-48f1-8606-292fe954cc69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Acquiring lock "cinder-quobyte-97ef95ad-948e-4151-918e-df6f55bd8a86" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:08 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4d7e5964-4058-4de5-9cf5-be6d361e5912 tempest-VolumesActionsTest-640027547 None] Created volume successfully. Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-quobyte-97ef95ad-948e-4151-918e-df6f55bd8a86" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e7c23-d822-4249-b579-0c45b768bd64]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:08 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 Apr 13 09:44:08 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:08 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:08 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86 Apr 13 09:44:08 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:09 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-97ef95ad-948e-4151-918e-df6f55bd8a86" returned: 0 in 0.697s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-quobyte-97ef95ad-948e-4151-918e-df6f55bd8a86" released by "delete_volume" :: held 1.235s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Created reservations ['38e8b002-5722-4b5b-985c-d7a4384684cb', '825bb90e-8693-4f63-bf41-450f8bac9d6d', '71d8d38f-cfdf-4304-99f9-92af78d8fd6e', 'f2e340d6-d58b-4504-9f1f-6a7c75725b62'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:09 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:09 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Acquiring lock "cinder-40b7c244-65b0-4742-b415-6a7378fdd12a-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Lock "cinder-40b7c244-65b0-4742-b415-6a7378fdd12a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Acquiring lock "cinder-quobyte-40b7c244-65b0-4742-b415-6a7378fdd12a" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Lock "cinder-quobyte-40b7c244-65b0-4742-b415-6a7378fdd12a" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7374e528-0a9b-4be6-ae75-d420886e84ff]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:10 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a Apr 13 09:44:10 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:10 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.943s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:10 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a" returned: 0 in 0.627s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:10 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Deleted volume successfully. Apr 13 09:44:10 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a Apr 13 09:44:10 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0e873b-3920-401d-94d7-f6ce1c401433 tempest-VolumesTransfersTest-269990669 None] Lock "cinder-97ef95ad-948e-4151-918e-df6f55bd8a86-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:11 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-40b7c244-65b0-4742-b415-6a7378fdd12a" returned: 0 in 1.005s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Lock "cinder-quobyte-40b7c244-65b0-4742-b415-6a7378fdd12a" released by "delete_volume" :: held 1.671s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Created reservations ['2414c03f-5677-4105-b84b-44029fe0406b', '4a253e89-cd24-4f96-b2f6-fa9929f387af', 'a058d329-feeb-47cd-a308-87a584e579fc', '9f905661-bff5-4ba5-85fb-a6e877695191'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Flow 'volume_create_manager' (119a6c9a-8298-4fe5-8a6c-936dedc4db2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a36df8a-b9db-4359-b428-e1968ee86e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a36df8a-b9db-4359-b428-e1968ee86e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-458703741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e360e811-2161-4de3-9605-fc311a3807a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451f1046d0a347668bc6b4a7e5028948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:12Z,use_quota=True,user_id='accb74fc24b84586b13a0459f723894c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc02568-d3c1-46ea-bcac-86716a474629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc02568-d3c1-46ea-bcac-86716a474629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5b5fc2-3e1a-497d-a9cb-bfcf078d4304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5b5fc2-3e1a-497d-a9cb-bfcf078d4304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e360e811-2161-4de3-9605-fc311a3807a8', 'volume_name': 'volume-e360e811-2161-4de3-9605-fc311a3807a8', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c755b213-cec8-4b79-b5b7-4299aaa7ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c755b213-cec8-4b79-b5b7-4299aaa7ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6a4587-cac3-40c7-9ffe-dc2bf4239b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:12 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Volume e360e811-2161-4de3-9605-fc311a3807a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e360e811-2161-4de3-9605-fc311a3807a8', 'volume_size': 1} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-458703741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e360e811-2161-4de3-9605-fc311a3807a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451f1046d0a347668bc6b4a7e5028948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:12Z,use_quota=True,user_id='accb74fc24b84586b13a0459f723894c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Creating volume e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:12 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:12 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:12 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:12 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 1073741824 Apr 13 09:44:12 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:12 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.889s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:12 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Deleted volume successfully. Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-55545370-0f20-47b2-baa3-9b790c8d3022 tempest-VolumesActionsTest-640027547 None] Lock "cinder-40b7c244-65b0-4742-b415-6a7378fdd12a-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:12 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 1073741824" returned: 0 in 0.893s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:12 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:44:12 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:13 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.600s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6a4587-cac3-40c7-9ffe-dc2bf4239b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e360e811-2161-4de3-9605-fc311a3807a8', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e789ee-72a3-4cf9-8f6d-41eeff20b40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:13 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Volume volume-e360e811-2161-4de3-9605-fc311a3807a8 (e360e811-2161-4de3-9605-fc311a3807a8): created successfully Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e789ee-72a3-4cf9-8f6d-41eeff20b40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Flow 'volume_create_manager' (119a6c9a-8298-4fe5-8a6c-936dedc4db2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:13 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3a3378a5-44e6-466e-adce-9d5513dca5cd tempest-VolumesActionsTest-1436460640 None] Created volume successfully. Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Flow 'volume_create_manager' (b01d4dc4-c8bf-47e6-84ec-9264a647650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d73d569-c3f8-4d1e-bb1c-a85d359c5745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d73d569-c3f8-4d1e-bb1c-a85d359c5745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1317443549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4028857b-0788-4ae6-b655-3dc499fb89db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b18d7fafd14e7c82f39022248719ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:17Z,use_quota=True,user_id='c1284bc4dd0744a9924f204628639980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2b6c16-5bf0-4020-8572-819dd8d8815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2b6c16-5bf0-4020-8572-819dd8d8815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bd581f-06f1-47ad-86d3-df0788e96188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bd581f-06f1-47ad-86d3-df0788e96188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4028857b-0788-4ae6-b655-3dc499fb89db', 'volume_name': 'volume-4028857b-0788-4ae6-b655-3dc499fb89db', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a820f8-18ac-41dc-9a89-10139487afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a820f8-18ac-41dc-9a89-10139487afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21be838f-7ab2-49b3-a47d-3a3111e4ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:17 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Volume 4028857b-0788-4ae6-b655-3dc499fb89db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4028857b-0788-4ae6-b655-3dc499fb89db', 'volume_size': 1} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1317443549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4028857b-0788-4ae6-b655-3dc499fb89db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b18d7fafd14e7c82f39022248719ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:17Z,use_quota=True,user_id='c1284bc4dd0744a9924f204628639980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Creating volume 4028857b-0788-4ae6-b655-3dc499fb89db {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:17 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:17 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db 1073741824 Apr 13 09:44:17 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:17 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db 1073741824" returned: 0 in 0.743s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:17 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db Apr 13 09:44:17 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:18 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db" returned: 0 in 0.694s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21be838f-7ab2-49b3-a47d-3a3111e4ac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4028857b-0788-4ae6-b655-3dc499fb89db', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1571da4e-ba71-4bae-99ab-0ee5d0e708c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:18 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Volume volume-4028857b-0788-4ae6-b655-3dc499fb89db (4028857b-0788-4ae6-b655-3dc499fb89db): created successfully Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1571da4e-ba71-4bae-99ab-0ee5d0e708c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Flow 'volume_create_manager' (b01d4dc4-c8bf-47e6-84ec-9264a647650a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-aedae661-f700-43e3-b3a5-52c58ea587e3 tempest-VolumesNegativeTest-721670028 None] Created volume successfully. Apr 13 09:44:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-7406876a-6b2d-478c-bd14-61a03dcb61af tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Terminate volume connection completed successfully. Apr 13 09:44:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-7406876a-6b2d-478c-bd14-61a03dcb61af tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Deleting attachment dfb08a0e-81d7-4687-be6c-b5016e498420. {{(pid=82295) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "cinder-a8ea4827-6c2c-45ff-88ae-eeac19b70e90-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-a8ea4827-6c2c-45ff-88ae-eeac19b70e90-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "cinder-quobyte-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-quobyte-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c0b606-ea91-4645-a38d-29a22b5a785f]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:23 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:44:23 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:23 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 0 in 0.600s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:23 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:44:23 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:24 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 1 in 0.598s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:44:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:24 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90 Apr 13 09:44:24 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:24 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" returned: 0 in 0.563s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:24 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-quobyte-a8ea4827-6c2c-45ff-88ae-eeac19b70e90" released by "delete_volume" :: held 1.835s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:24 devstack cinder-volume[82295]: DEBUG cinder.quota [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Created reservations ['7fcc3020-1e83-4fe7-af7d-216557e72174', 'eac66cea-416e-4caf-a743-a06036754781', '08d8463e-5ab9-4e9a-8b1d-ef13e2551845', 'b3220e8f-b0da-404c-9e6c-f5132e03c5a9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:25 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:25 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Flow 'volume_create_manager' (d5589d19-3478-4d2a-b726-12a084d7e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a37faa-bf15-4ee9-a55d-3e83ec8ec3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a37faa-bf15-4ee9-a55d-3e83ec8ec3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1454176036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd075c3-20a3-4342-a33e-15822c08225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a03a2b71cf41be9553f08b807064ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:25Z,use_quota=True,user_id='4bf555d49f614f55a300a86d06e3a0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0344188-6f4e-4339-b6c3-c5d840a7b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0344188-6f4e-4339-b6c3-c5d840a7b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b430c98-63a0-499a-9a4f-a85766cc3aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.image.glance [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Creating Keystone auth plugin from conf {{(pid=82295) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b430c98-63a0-499a-9a4f-a85766cc3aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bd075c3-20a3-4342-a33e-15822c08225b', 'volume_name': 'volume-8bd075c3-20a3-4342-a33e-15822c08225b', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3f3081-6439-4520-8ed8-156cd34268a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3f3081-6439-4520-8ed8-156cd34268a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efef07b5-1563-48a1-a949-f8602a0fc1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Volume 8bd075c3-20a3-4342-a33e-15822c08225b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bd075c3-20a3-4342-a33e-15822c08225b', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Trying to clone 8bd075c3-20a3-4342-a33e-15822c08225b from image 168ef6f7-3a65-468d-bd46-416aedea31b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]). {{(pid=82295) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 09:44:25 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Image download 20.69 MB at 20.69 MB/s Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff0afcd-d760-4e7d-b3cf-530f116b7f46]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:25 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD Apr 13 09:44:25 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:25 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.616s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.manager [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Deleted volume successfully. Apr 13 09:44:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-598be9cc-a9d7-45c8-95e2-2c2ee1dc9c52 req-00da764e-1383-449d-8dce-f502ac6b06f7 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-a8ea4827-6c2c-45ff-88ae-eeac19b70e90-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:26 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD" returned: 0 in 0.567s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:26 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 is fetched for user 4bf555d49f614f55a300a86d06e3a0db. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 09:44:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60d18a0-42b7-42a7-87cd-1aec447b5f31]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:26 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD Apr 13 09:44:26 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:27 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1454176036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd075c3-20a3-4342-a33e-15822c08225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a03a2b71cf41be9553f08b807064ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:25Z,use_quota=True,user_id='4bf555d49f614f55a300a86d06e3a0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Creating volume 8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:27 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:27 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b 1073741824 Apr 13 09:44:27 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:27 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b 1073741824" returned: 0 in 0.612s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:27 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:27 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:28 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 0 in 0.689s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:28 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Attempting download of 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume 8bd075c3-20a3-4342-a33e-15822c08225b. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 09:44:28 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8644407-d9bf-4029-9e65-96998635d795]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:28 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii Apr 13 09:44:28 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:29 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii" returned: 0 in 0.552s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:29 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii Apr 13 09:44:29 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cda3212c-6971-4c2b-951c-f609c00dacde tempest-VolumesActionsTest-1436460640 None] Acquiring lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8" by "attach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cda3212c-6971-4c2b-951c-f609c00dacde tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8" acquired by "attach_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cda3212c-6971-4c2b-951c-f609c00dacde tempest-VolumesActionsTest-1436460640 None] Attaching volume e360e811-2161-4de3-9605-fc311a3807a8 to instance 15c5a89b-375c-4e3b-b505-ef72aa953acc at mountpoint /dev/vdb on host None. Apr 13 09:44:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cda3212c-6971-4c2b-951c-f609c00dacde tempest-VolumesActionsTest-1436460640 None] Attach volume completed successfully. Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cda3212c-6971-4c2b-951c-f609c00dacde tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8" released by "attach_volume" :: held 0.057s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:29 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii" returned: 1 in 0.574s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_8mmz99ii' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6891a0-505c-462d-a9bc-967c93549f7d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:29 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD Apr 13 09:44:29 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1a30c922-8371-49c4-8eb6-fbbd96461e6f tempest-VolumesActionsTest-1436460640 None] Acquiring lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-detach_volume" by "detach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1a30c922-8371-49c4-8eb6-fbbd96461e6f tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1a30c922-8371-49c4-8eb6-fbbd96461e6f tempest-VolumesActionsTest-1436460640 None] Detaching volume e360e811-2161-4de3-9605-fc311a3807a8 from instance 15c5a89b-375c-4e3b-b505-ef72aa953acc. Apr 13 09:44:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1a30c922-8371-49c4-8eb6-fbbd96461e6f tempest-VolumesActionsTest-1436460640 None] Detach volume completed successfully. Apr 13 09:44:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1a30c922-8371-49c4-8eb6-fbbd96461e6f tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:30 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD" returned: 0 in 0.587s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:30 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] 168ef6f7-3a65-468d-bd46-416aedea31b3 was qcow2, converting to raw {{(pid=82295) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 09:44:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:30 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:30 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:31 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 0 in 1.149s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:31 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_lag8gc56devstack@QuobyteHD, size 112.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:44:31 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Converted 112.00 MB image at 97.33 MB/s Apr 13 09:44:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:31 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b 1G Apr 13 09:44:31 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:32 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b 1G" returned: 0 in 0.882s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5477cef-37e6-4d58-878d-fd0dee682fb4]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:32 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:32 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:33 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 0 in 0.679s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:33 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:33 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:33 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 1 in 0.757s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Downloaded image 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume 8bd075c3-20a3-4342-a33e-15822c08225b successfully. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 for user 4bf555d49f614f55a300a86d06e3a0db is deleted. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Marking volume 8bd075c3-20a3-4342-a33e-15822c08225b as bootable. {{(pid=82295) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=131,cinder:UPDATE=176,cinder:INSERT=47,cinder:DELETE=12 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Copying metadata from image 168ef6f7-3a65-468d-bd46-416aedea31b3 to 8bd075c3-20a3-4342-a33e-15822c08225b. {{(pid=82295) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Creating volume glance metadata for volume 8bd075c3-20a3-4342-a33e-15822c08225b backed by image 168ef6f7-3a65-468d-bd46-416aedea31b3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82295) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=149,cinder:UPDATE=184,cinder:INSERT=49,cinder:DELETE=18 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efef07b5-1563-48a1-a949-f8602a0fc1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd075c3-20a3-4342-a33e-15822c08225b', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aad2cd2-2d54-454b-9bbc-7cd9ced8381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:33 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Volume volume-8bd075c3-20a3-4342-a33e-15822c08225b (8bd075c3-20a3-4342-a33e-15822c08225b): created successfully Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aad2cd2-2d54-454b-9bbc-7cd9ced8381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:33 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Flow 'volume_create_manager' (d5589d19-3478-4d2a-b726-12a084d7e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:33 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2ad5f482-5547-4864-87d1-8b8a9d0539f2 tempest-VolumesImageMetadata-616374908 None] Created volume successfully. Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Acquiring lock "cinder-8bd075c3-20a3-4342-a33e-15822c08225b-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Lock "cinder-8bd075c3-20a3-4342-a33e-15822c08225b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Acquiring lock "cinder-quobyte-8bd075c3-20a3-4342-a33e-15822c08225b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Lock "cinder-quobyte-8bd075c3-20a3-4342-a33e-15822c08225b" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0d252-e5ac-402d-aab3-4c563b26f13a]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:35 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:35 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:35 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 0 in 0.552s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:35 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:35 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:36 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 1 in 0.627s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:36 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b Apr 13 09:44:36 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:36 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8bd075c3-20a3-4342-a33e-15822c08225b" returned: 0 in 0.448s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Lock "cinder-quobyte-8bd075c3-20a3-4342-a33e-15822c08225b" released by "delete_volume" :: held 1.675s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Created reservations ['3a78cde4-5386-4e2a-8f5e-6ba8bc3f7466', '19ec6c35-c181-490e-b148-6732ffcac8c1', '045410e6-7b57-4d7b-8fc5-145b32549aed', '794c7d68-ec88-465e-b8fb-da8de0cb8d49'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:36 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:36 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:37 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:37 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Deleted volume successfully. Apr 13 09:44:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6707656e-9f46-4f8d-a200-70870ee4ac51 tempest-VolumesImageMetadata-616374908 None] Lock "cinder-8bd075c3-20a3-4342-a33e-15822c08225b-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-71421cd4-4837-4cf1-83e4-5499e3e0666d tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Terminate volume connection completed successfully. Apr 13 09:44:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-71421cd4-4837-4cf1-83e4-5499e3e0666d tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Deleting attachment 92d4540d-68a8-4231-99a7-95b7e6009e54. {{(pid=82295) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "cinder-78ab44a2-a78a-48fc-b422-cf8189f37d68-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-78ab44a2-a78a-48fc-b422-cf8189f37d68-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "cinder-quobyte-78ab44a2-a78a-48fc-b422-cf8189f37d68" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-quobyte-78ab44a2-a78a-48fc-b422-cf8189f37d68" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d830e5-e53c-47f5-beb4-33c90a11a122]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:39 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 Apr 13 09:44:39 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Flow 'volume_create_manager' (e6067e2e-f9fb-447a-a7e2-90192e2a36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d485efe-a6af-427e-a24d-d28b928fefe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d485efe-a6af-427e-a24d-d28b928fefe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-301762552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90860b1542f745f495f9fab30ce0060e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:40Z,use_quota=True,user_id='1884b4f899a6419ebafafcf5ba893708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850cafb9-1cbc-426b-95dd-bfb2b60dedf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850cafb9-1cbc-426b-95dd-bfb2b60dedf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a1fc37-2347-4a3c-8ba6-f7150b114a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a1fc37-2347-4a3c-8ba6-f7150b114a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed', 'volume_name': 'volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8b3783-9016-4db0-91a6-c181b10f347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8b3783-9016-4db0-91a6-c181b10f347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b69af45-9091-4019-8ce7-91df836d72be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:39 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Volume b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed', 'volume_size': 1} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-301762552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90860b1542f745f495f9fab30ce0060e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:40Z,use_quota=True,user_id='1884b4f899a6419ebafafcf5ba893708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Creating volume b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:39 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:39 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed 1073741824 Apr 13 09:44:39 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:39 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68" returned: 0 in 0.613s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:39 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68 Apr 13 09:44:39 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:40 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed 1073741824" returned: 0 in 0.538s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:40 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-78ab44a2-a78a-48fc-b422-cf8189f37d68" returned: 0 in 0.509s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-quobyte-78ab44a2-a78a-48fc-b422-cf8189f37d68" released by "delete_volume" :: held 1.147s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:40 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed Apr 13 09:44:40 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.quota [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Created reservations ['e7bb50eb-e68f-4c7b-b27a-b076306c59df', '30ecae14-9ada-447a-ab63-46c3aaf533ac', 'c6828e54-078e-49b5-96bc-29105ae00c65', 'f5e46aa2-f12a-4244-8759-3edb6149f298'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:40 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:40 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:40 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b69af45-9091-4019-8ce7-91df836d72be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903050d9-f405-4ad9-94a7-63e7cd51c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:40 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Volume volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed (b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed): created successfully Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903050d9-f405-4ad9-94a7-63e7cd51c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Flow 'volume_create_manager' (e6067e2e-f9fb-447a-a7e2-90192e2a36e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1a20e751-4109-406c-9bf4-1a111376f2b2 tempest-VolumesMetadataTest-1166799491 None] Created volume successfully. Apr 13 09:44:40 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.468s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.manager [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Deleted volume successfully. Apr 13 09:44:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-8d063bd5-7a38-4717-9ff1-695ec5491534 req-8025b707-b8cc-4a5d-9ec4-ae0c70facb41 tempest-ServerBootFromVolumeStableRescueTest-18407672 None] Lock "cinder-78ab44a2-a78a-48fc-b422-cf8189f37d68-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Acquiring lock "cinder-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Lock "cinder-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Acquiring lock "cinder-quobyte-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Lock "cinder-quobyte-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8635631a-e4d1-461c-874c-ad64e3304594]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:42 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed Apr 13 09:44:42 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:42 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed" returned: 0 in 0.574s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:42 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed Apr 13 09:44:42 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:43 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed" returned: 0 in 0.495s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Lock "cinder-quobyte-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed" released by "delete_volume" :: held 1.127s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Created reservations ['3e887463-0c3e-4001-b74f-2b5de9ddb825', '47eeccf1-7ccd-4f9e-8cdc-b52760077e17', '0eb442f6-0fd9-4dfd-96be-fcdead50f619', 'c00ca814-8f05-4d91-b9ca-c2041fe52c7f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:43 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:43 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:44 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.579s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:44 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:44 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Deleted volume successfully. Apr 13 09:44:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ebc02ea8-1acf-4105-bc88-e72d70e34984 tempest-VolumesMetadataTest-1166799491 None] Lock "cinder-b6ed1b95-e8b2-4ea2-ad7a-e4fbebd6dbed-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Acquiring lock "cinder-4028857b-0788-4ae6-b655-3dc499fb89db-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Lock "cinder-4028857b-0788-4ae6-b655-3dc499fb89db-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Acquiring lock "cinder-quobyte-4028857b-0788-4ae6-b655-3dc499fb89db" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Lock "cinder-quobyte-4028857b-0788-4ae6-b655-3dc499fb89db" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b1810-f8ac-4684-bc3b-ad3a14f8ee9c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:46 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db Apr 13 09:44:46 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:46 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db" returned: 0 in 0.582s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:46 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db Apr 13 09:44:46 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Flow 'volume_create_manager' (73490f93-e838-476a-adb7-c991522f311f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980a9792-7262-4758-811b-a7be332608ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980a9792-7262-4758-811b-a7be332608ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1411702307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bba35a-9408-4878-8bde-fc2a328ed28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a3164885748b0a321455c35950c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:47Z,use_quota=True,user_id='3f79316962d34b56ace59c5a316c4fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8369d1ed-85c9-4563-8ae6-548b9e24159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8369d1ed-85c9-4563-8ae6-548b9e24159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1ebc85-ebe5-4a2b-a8b5-ecec4e6caedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1ebc85-ebe5-4a2b-a8b5-ecec4e6caedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bba35a-9408-4878-8bde-fc2a328ed28a', 'volume_name': 'volume-e7bba35a-9408-4878-8bde-fc2a328ed28a', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6043590e-f7eb-408a-8e65-5a0cdcc34f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6043590e-f7eb-408a-8e65-5a0cdcc34f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee188998-302c-4efd-8e05-6e2f4f6fa9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:47 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Volume e7bba35a-9408-4878-8bde-fc2a328ed28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bba35a-9408-4878-8bde-fc2a328ed28a', 'volume_size': 1} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1411702307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bba35a-9408-4878-8bde-fc2a328ed28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a3164885748b0a321455c35950c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:47Z,use_quota=True,user_id='3f79316962d34b56ace59c5a316c4fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Creating volume e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:47 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:47 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a 1073741824 Apr 13 09:44:47 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:47 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4028857b-0788-4ae6-b655-3dc499fb89db" returned: 0 in 0.443s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Lock "cinder-quobyte-4028857b-0788-4ae6-b655-3dc499fb89db" released by "delete_volume" :: held 1.061s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Created reservations ['1d772c11-b74d-4bc9-806b-d7bb8d89005d', 'df0ac5c2-c2ef-44e4-8ff5-245de6066c2a', '82096923-5922-428e-bf80-36b3b4c8fc3a', '6880089a-112c-4386-96f2-7c2be2e5522b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:47 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:44:47 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:47 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a 1073741824" returned: 0 in 0.545s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:47 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:44:47 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:47 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.494s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:44:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Deleted volume successfully. Apr 13 09:44:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d79e94bb-3755-4538-b352-d95ea9be881b tempest-VolumesNegativeTest-721670028 None] Lock "cinder-4028857b-0788-4ae6-b655-3dc499fb89db-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:48 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee188998-302c-4efd-8e05-6e2f4f6fa9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bba35a-9408-4878-8bde-fc2a328ed28a', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d578d4-38ff-46ca-b961-df4c4a723917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:48 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Volume volume-e7bba35a-9408-4878-8bde-fc2a328ed28a (e7bba35a-9408-4878-8bde-fc2a328ed28a): created successfully Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d578d4-38ff-46ca-b961-df4c4a723917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Flow 'volume_create_manager' (73490f93-e838-476a-adb7-c991522f311f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-81a9c058-c833-45f6-aa3a-b88d957d363c tempest-VolumesCloneTest-1407260720 None] Created volume successfully. Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Flow 'volume_create_manager' (c191aa35-b738-402c-a98d-8e5865a79877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a2b66a-bf29-4704-b5af-929e205eae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a2b66a-bf29-4704-b5af-929e205eae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1010423731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4fdfb5-6b2f-4987-bde8-f8b864d5753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993a3164885748b0a321455c35950c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e7bba35a-9408-4878-8bde-fc2a328ed28a,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:49Z,use_quota=True,user_id='3f79316962d34b56ace59c5a316c4fe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578a6c4a-0926-4d65-9a88-66bf0b17d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578a6c4a-0926-4d65-9a88-66bf0b17d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f0eb6d-9a33-4dc6-9c60-5d30d161a09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f0eb6d-9a33-4dc6-9c60-5d30d161a09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5e4fdfb5-6b2f-4987-bde8-f8b864d5753e', 'volume_name': 'volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e', 'volume_size': 2, 'source_volid': 'e7bba35a-9408-4878-8bde-fc2a328ed28a', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ec2464-e87e-47d9-8768-4527c6ff4749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ec2464-e87e-47d9-8768-4527c6ff4749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c254d16-42ea-4ba7-ad63-ea31a969fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Volume 5e4fdfb5-6b2f-4987-bde8-f8b864d5753e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e', 'volume_size': 2, 'source_volid': 'e7bba35a-9408-4878-8bde-fc2a328ed28a', 'source_volstatus': 'available'} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:49 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Cloning volume e7bba35a-9408-4878-8bde-fc2a328ed28a to volume 5e4fdfb5-6b2f-4987-bde8-f8b864d5753e Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Creating offline snapshot 36ac82a9-6192-4ed6-b4c2-aae9f3469d89 of volume e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678def5-8ffd-43dd-9fa1-477bf2365f9f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:49 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:44:49 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Flow 'volume_create_manager' (65a5b032-3b10-4241-b4d5-402341976c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a437fb-a6d9-49c2-8cdc-07b8d76ea92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a437fb-a6d9-49c2-8cdc-07b8d76ea92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1466610242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf61d95-92db-4ab2-ba29-c400005a1c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88552100e5d4aceb23be1e184f273ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:50Z,use_quota=True,user_id='4c2d2f05e1cf416d8feb65bc23f0c1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e51e53-8d1d-4a31-b707-baf4ad1ae25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e51e53-8d1d-4a31-b707-baf4ad1ae25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165eb5e9-ee69-4760-a6de-9f43565f5473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165eb5e9-ee69-4760-a6de-9f43565f5473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf61d95-92db-4ab2-ba29-c400005a1c35', 'volume_name': 'volume-fbf61d95-92db-4ab2-ba29-c400005a1c35', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b8b5a2-7a91-43a6-8c8c-d32469d0cd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b8b5a2-7a91-43a6-8c8c-d32469d0cd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544b9a78-dfac-4c89-9e91-9c9662ad5af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:50 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Volume fbf61d95-92db-4ab2-ba29-c400005a1c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf61d95-92db-4ab2-ba29-c400005a1c35', 'volume_size': 1} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:50 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.596s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:50 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 1G Apr 13 09:44:50 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:50 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 1G" returned: 0 in 0.688s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bba35a-9408-4878-8bde-fc2a328ed28a -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:50 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bba35a-9408-4878-8bde-fc2a328ed28a -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 Apr 13 09:44:50 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:51 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bba35a-9408-4878-8bde-fc2a328ed28a -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89" returned: 0 in 0.564s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:51 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 is being set with open permissions: ugo+rw Apr 13 09:44:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:51 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 Apr 13 09:44:51 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:52 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89" returned: 0 in 0.613s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:52 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info Apr 13 09:44:52 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:52 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:52 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info is being set with open permissions: ugo+rw Apr 13 09:44:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:52 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info Apr 13 09:44:52 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:53 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.info" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "cinder-quobyte-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] snapshot: 36ac82a9-6192-4ed6-b4c2-aae9f3469d89, volume: 5e4fdfb5-6b2f-4987-bde8-f8b864d5753e, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9cc923-dc3a-42f6-8924-34948c3b0064]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0519877f-d0f4-4d2d-a96d-4ad0fed379f8 tempest-VolumesActionsTest-1436460640 None] Acquiring lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8" by "attach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0519877f-d0f4-4d2d-a96d-4ad0fed379f8 tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8" acquired by "attach_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:53 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 Apr 13 09:44:53 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0519877f-d0f4-4d2d-a96d-4ad0fed379f8 tempest-VolumesActionsTest-1436460640 None] Attaching volume e360e811-2161-4de3-9605-fc311a3807a8 to instance 856939eb-a26a-45fd-af27-5f8163ce2ec4 at mountpoint /dev/vdb on host None. Apr 13 09:44:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0519877f-d0f4-4d2d-a96d-4ad0fed379f8 tempest-VolumesActionsTest-1436460640 None] Attach volume completed successfully. Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0519877f-d0f4-4d2d-a96d-4ad0fed379f8 tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8" released by "attach_volume" :: held 0.065s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:53 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89" returned: 0 in 0.619s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7bba35a-9408-4878-8bde-fc2a328ed28a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556fe7b-20ba-4cab-b4e7-70bf7c66a0cf]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-97b93aee-b354-42a7-a3b3-893773345246 tempest-VolumesActionsTest-1436460640 None] Acquiring lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-detach_volume" by "detach_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-97b93aee-b354-42a7-a3b3-893773345246 tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:53 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:44:53 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-97b93aee-b354-42a7-a3b3-893773345246 tempest-VolumesActionsTest-1436460640 None] Detaching volume e360e811-2161-4de3-9605-fc311a3807a8 from instance 856939eb-a26a-45fd-af27-5f8163ce2ec4. Apr 13 09:44:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-97b93aee-b354-42a7-a3b3-893773345246 tempest-VolumesActionsTest-1436460640 None] Detach volume completed successfully. Apr 13 09:44:53 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-97b93aee-b354-42a7-a3b3-893773345246 tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:54 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.584s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:54 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e Apr 13 09:44:54 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Flow 'volume_create_manager' (9774663b-3ba1-420a-9b7d-b23f0fb82258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad91bd0-342f-45a0-a3d5-f4503ff6f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad91bd0-342f-45a0-a3d5-f4503ff6f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-22248434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa09d56-f0dc-4196-9b5a-d69e7483509d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cd74378d6724cd292c8093eca0a5232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:55Z,use_quota=True,user_id='e610e11d3bc94c219793f8d00dca4296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57485a1c-19f9-4352-bdc5-25ab1975d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57485a1c-19f9-4352-bdc5-25ab1975d282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6dbab7-3175-4d40-9ca5-be0d27872d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6dbab7-3175-4d40-9ca5-be0d27872d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa09d56-f0dc-4196-9b5a-d69e7483509d', 'volume_name': 'volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a97a1b-859b-442b-9f29-a097b5961cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a97a1b-859b-442b-9f29-a097b5961cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75448c72-df2c-4820-8b71-c7bc43a0afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:54 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Volume 6fa09d56-f0dc-4196-9b5a-d69e7483509d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d', 'volume_size': 1} Apr 13 09:44:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:56 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" returned: 0 in 2.499s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959f251-866c-433e-82e4-c9ff1f29c741]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:56 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:44:56 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:57 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.593s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:44:57 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Converted 1024.00 MB image at 409.59 MB/s Apr 13 09:44:57 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e is being set with open permissions: ugo+rw Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:57 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e Apr 13 09:44:57 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:57 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" returned: 0 in 0.417s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" released by "_copy_volume_from_snapshot" :: held 4.763s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "cinder-quobyte-36ac82a9-6192-4ed6-b4c2-aae9f3469d89" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-36ac82a9-6192-4ed6-b4c2-aae9f3469d89" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Deleting offline snapshot 36ac82a9-6192-4ed6-b4c2-aae9f3469d89 of volume e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] snapshot_file for this snap is: volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4afc009-342e-4127-947e-7d4bd3b03986]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:58 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 Apr 13 09:44:58 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:58 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:58 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7bba35a-9408-4878-8bde-fc2a328ed28a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:44:58 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf9f79b-e994-4c37-acbc-ea1946bf692f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:44:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:58 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:44:58 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:58 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.540s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:59 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 Apr 13 09:44:59 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:59 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89" returned: 0 in 0.478s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:59 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89 Apr 13 09:44:59 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:59 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a.36ac82a9-6192-4ed6-b4c2-aae9f3469d89" returned: 0 in 0.412s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-36ac82a9-6192-4ed6-b4c2-aae9f3469d89" released by "_delete_snapshot" :: held 1.947s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.392s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.787s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1466610242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf61d95-92db-4ab2-ba29-c400005a1c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88552100e5d4aceb23be1e184f273ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:50Z,use_quota=True,user_id='4c2d2f05e1cf416d8feb65bc23f0c1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Creating volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:44:59 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c254d16-42ea-4ba7-ad63-ea31a969fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e', 'volume_size': 2, 'source_volid': 'e7bba35a-9408-4878-8bde-fc2a328ed28a', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7801b0a1-3b97-4266-84a8-a767d6c65d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:44:59 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 1073741824 Apr 13 09:44:59 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:44:59 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Volume volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e (5e4fdfb5-6b2f-4987-bde8-f8b864d5753e): created successfully Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7801b0a1-3b97-4266-84a8-a767d6c65d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:44:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Flow 'volume_create_manager' (c191aa35-b738-402c-a98d-8e5865a79877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:44:59 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3f80e660-ea0e-4a3b-b655-8511b94da541 tempest-VolumesCloneTest-1407260720 None] Created volume successfully. Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "cinder-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "cinder-quobyte-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ed804-d46c-419b-92b5-ad01ad70b786]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:00 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e Apr 13 09:45:00 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:00 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:00 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:00 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 1073741824" returned: 0 in 0.562s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:00 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 Apr 13 09:45:00 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:00 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" returned: 0 in 0.490s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:00 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e Apr 13 09:45:00 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:00 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.462s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:00 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35" returned: 0 in 0.424s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.057s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-22248434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa09d56-f0dc-4196-9b5a-d69e7483509d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9cd74378d6724cd292c8093eca0a5232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:44:55Z,use_quota=True,user_id='e610e11d3bc94c219793f8d00dca4296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Creating volume 6fa09d56-f0dc-4196-9b5a-d69e7483509d {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:00 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544b9a78-dfac-4c89-9e91-9c9662ad5af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf61d95-92db-4ab2-ba29-c400005a1c35', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a47e4a-1c5d-4492-a90f-5da9c4e666a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:00 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d 1073741824 Apr 13 09:45:00 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:00 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Volume volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 (fbf61d95-92db-4ab2-ba29-c400005a1c35): created successfully Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a47e4a-1c5d-4492-a90f-5da9c4e666a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Flow 'volume_create_manager' (65a5b032-3b10-4241-b4d5-402341976c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9fee1ca4-bbb6-48e5-a2f7-9e97623132f7 tempest-VolumesSnapshotListTestJSON-1738204307 None] Created volume successfully. Apr 13 09:45:01 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" returned: 0 in 0.440s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e" released by "delete_volume" :: held 0.967s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Created reservations ['77038a94-adb5-4c59-8d98-f2878c22e8d6', '25fd0154-cdea-4849-928e-a37183e5d1ec', 'ae3f8777-d695-413b-81c8-9882319ceed1', '9250d8b1-f6fc-470e-a459-b12a9577f366'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:01 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:01 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Acquiring lock "cinder-e7bba35a-9408-4878-8bde-fc2a328ed28a-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Lock "cinder-e7bba35a-9408-4878-8bde-fc2a328ed28a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Acquiring lock "cinder-quobyte-e7bba35a-9408-4878-8bde-fc2a328ed28a" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-e7bba35a-9408-4878-8bde-fc2a328ed28a" acquired by "delete_volume" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c94570-c15b-4fc0-9067-9e7717a215a2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:01 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d 1073741824" returned: 0 in 0.604s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:01 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:45:01 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:01 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d Apr 13 09:45:01 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:01 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.506s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Deleted volume successfully. Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fb99ce94-6dcb-43b5-b503-6edd55c63171 tempest-VolumesCloneTest-1407260720 None] Lock "cinder-5e4fdfb5-6b2f-4987-bde8-f8b864d5753e-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:02 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.611s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:02 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a Apr 13 09:45:02 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:02 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d" returned: 0 in 0.532s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.134s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75448c72-df2c-4820-8b71-c7bc43a0afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c461a4-6207-4e31-b407-b1f6d2c3d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Creating offline snapshot 40d443c4-ded1-4959-a43e-34e13f82eb5c of volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:45:02 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Volume volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d (6fa09d56-f0dc-4196-9b5a-d69e7483509d): created successfully Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c461a4-6207-4e31-b407-b1f6d2c3d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Flow 'volume_create_manager' (9774663b-3ba1-420a-9b7d-b23f0fb82258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2956e-74a4-45fa-90f6-4c42aa3d6723]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:02 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-6abfb022-7ce0-4e90-b404-2ab64af11313 req-7af2faf7-157f-445b-9c78-32d117d3dbc7 tempest-VolumesGetTestJSON-303565658 None] Created volume successfully. Apr 13 09:45:02 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 Apr 13 09:45:02 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Acquiring lock "cinder-6fa09d56-f0dc-4196-9b5a-d69e7483509d-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Lock "cinder-6fa09d56-f0dc-4196-9b5a-d69e7483509d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Acquiring lock "cinder-quobyte-6fa09d56-f0dc-4196-9b5a-d69e7483509d" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Lock "cinder-quobyte-6fa09d56-f0dc-4196-9b5a-d69e7483509d" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffadd68a-15a1-4b77-bc09-d0f1b77d48cf]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:02 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d Apr 13 09:45:02 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:02 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e7bba35a-9408-4878-8bde-fc2a328ed28a" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Lock "cinder-quobyte-e7bba35a-9408-4878-8bde-fc2a328ed28a" released by "delete_volume" :: held 1.154s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Created reservations ['2e92e1a4-d248-416b-ad0d-6165ccab2b8d', 'b8bc7252-d528-4dbf-ad78-a0559fa66036', '87c1cb05-630e-41dd-a971-ce329dfb7fe9', 'b5a74be6-917e-4cb4-8428-bbf188a1ec8e'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:02 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:02 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:02 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35" returned: 0 in 0.649s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:02 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c 1G Apr 13 09:45:02 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:02 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d" returned: 0 in 0.491s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:02 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d Apr 13 09:45:02 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:03 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Deleted volume successfully. Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47603c35-ed76-4364-8075-75ccdeffbecb tempest-VolumesCloneTest-1407260720 None] Lock "cinder-e7bba35a-9408-4878-8bde-fc2a328ed28a-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:03 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c 1G" returned: 0 in 0.492s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:03 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:03 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:03 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6fa09d56-f0dc-4196-9b5a-d69e7483509d" returned: 0 in 0.444s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Lock "cinder-quobyte-6fa09d56-f0dc-4196-9b5a-d69e7483509d" released by "delete_volume" :: held 0.966s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG cinder.quota [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Created reservations ['863a3b67-e366-4d7f-9ba4-992a73a6ed01', '2715ea8e-1e08-4d48-8312-028516bd6ab1', 'fb601594-92c3-4497-9a88-d1ec3b442d94', 'd38852bb-4244-4d6c-94e2-e01a4d2d7d82'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:03 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:03 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:03 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.528s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:03 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c is being set with open permissions: ugo+rw Apr 13 09:45:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:03 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:03 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:04 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.510s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG cinder.manager [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Deleted volume successfully. Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [req-74729b61-47c2-48a1-93d2-cd689e1adcd6 req-54edd312-b5f6-48ff-8930-dc4e6ca9ade0 tempest-VolumesGetTestJSON-303565658 None] Lock "cinder-6fa09d56-f0dc-4196-9b5a-d69e7483509d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:04 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.459s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:04 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info Apr 13 09:45:04 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:04 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info" returned: 0 in 0.504s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:04 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info is being set with open permissions: ugo+rw Apr 13 09:45:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:04 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info Apr 13 09:45:04 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:05 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.info" returned: 0 in 0.495s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.217s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.802s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[592b254a-0ad9-4330-983f-f2439d9f5d24]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:05 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-71e394c9-eca2-4227-bbb1-beb1304c2afa tempest-VolumesSnapshotListTestJSON-1738204307 None] Create snapshot completed successfully Apr 13 09:45:05 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:05 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:05 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Flow 'volume_create_manager' (27be29a1-4e91-4935-9f25-4779ae742b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2ebe2e-8d71-4427-b96c-6077c957a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.563s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6418c6-a5e6-42df-9068-63806434bd95]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2ebe2e-8d71-4427-b96c-6077c957a090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1307680287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0eb0d7-6456-47a4-b3ff-7f9f18508667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f33447752348f8bf70c2420088407c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:06Z,use_quota=True,user_id='e73ba7a33d4c46e9bb80a15e5c7c4afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6392868e-292b-4832-bfc0-0531d075f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6392868e-292b-4832-bfc0-0531d075f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47704936-c77b-48ad-a162-67523a2e2e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:05 devstack cinder-volume[82295]: DEBUG cinder.image.glance [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Creating Keystone auth plugin from conf {{(pid=82295) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 09:45:06 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:06 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Flow 'volume_create_manager' (80d56e6c-36f1-4eb3-8a54-3f3744f36af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3d9275-7c85-4b1b-8023-85457ebd8c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3d9275-7c85-4b1b-8023-85457ebd8c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1748839060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d565f513-3b22-4407-9c60-a2aae1a4a56c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32999d5960b54d10a48e69f32b3c9bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:06Z,use_quota=True,user_id='bfccd241472d444a9f07dad4e7a0cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702b282a-0724-484a-a3ef-b7db4cfbf767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702b282a-0724-484a-a3ef-b7db4cfbf767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bb15e2-7118-4e3c-a4f0-342b561926a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bb15e2-7118-4e3c-a4f0-342b561926a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd565f513-3b22-4407-9c60-a2aae1a4a56c', 'volume_name': 'volume-d565f513-3b22-4407-9c60-a2aae1a4a56c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864181a9-82e5-4391-a8b1-31494dbab380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864181a9-82e5-4391-a8b1-31494dbab380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf248697-6f93-4374-9cc4-958a6718b449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Volume d565f513-3b22-4407-9c60-a2aae1a4a56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d565f513-3b22-4407-9c60-a2aae1a4a56c', 'volume_size': 1} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47704936-c77b-48ad-a162-67523a2e2e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a0eb0d7-6456-47a4-b3ff-7f9f18508667', 'volume_name': 'volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81260316-ee54-41f0-8546-d4003904370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81260316-ee54-41f0-8546-d4003904370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4697078-92b0-4d81-9243-7cf83a7a1dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:06 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Volume 6a0eb0d7-6456-47a4-b3ff-7f9f18508667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Trying to clone 6a0eb0d7-6456-47a4-b3ff-7f9f18508667 from image 168ef6f7-3a65-468d-bd46-416aedea31b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]). {{(pid=82295) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 09:45:06 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Image download 20.69 MB at 20.69 MB/s Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7315f103-7fb2-44a1-82c3-757aef105423]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:06 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD Apr 13 09:45:06 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:06 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.583s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.21095358-029e-4504-9b0d-7b3d8775d66c7_0y52e4.img {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:06 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.21095358-029e-4504-9b0d-7b3d8775d66c7_0y52e4.img Apr 13 09:45:06 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:06 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:06 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 is fetched for user e73ba7a33d4c46e9bb80a15e5c7c4afb. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 09:45:07 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c05773-6286-45a4-8e02-7cd2f62e41b3]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:07 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD Apr 13 09:45:07 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:08 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD" returned: 0 in 1.181s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:08 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.21095358-029e-4504-9b0d-7b3d8775d66c7_0y52e4.img" returned: 0 in 1.884s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[581cfa42-ca2e-46bc-80fd-7726bf7c09b5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:08 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:08 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:08 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:08 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.21095358-029e-4504-9b0d-7b3d8775d66c7_0y52e4.img {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:45:08 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Converted 1024.00 MB image at 543.39 MB/s Apr 13 09:45:09 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] 21095358-029e-4504-9b0d-7b3d8775d66c was raw, no need to convert to raw {{(pid=82295) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.045s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Uploaded volume to glance image-id: 21095358-029e-4504-9b0d-7b3d8775d66c. {{(pid=82295) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.262s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1748839060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d565f513-3b22-4407-9c60-a2aae1a4a56c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32999d5960b54d10a48e69f32b3c9bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:06Z,use_quota=True,user_id='bfccd241472d444a9f07dad4e7a0cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Creating volume d565f513-3b22-4407-9c60-a2aae1a4a56c {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:18 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:18 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c 1073741824 Apr 13 09:45:18 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b22cd4e7-d77b-4e47-b063-764f239b7bd8 tempest-VolumesActionsTest-1436460640 None] Copy volume to image completed successfully. Apr 13 09:45:18 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c 1073741824" returned: 0 in 0.464s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:18 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c Apr 13 09:45:18 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:19 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c" returned: 0 in 0.491s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.107s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf248697-6f93-4374-9cc4-958a6718b449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d565f513-3b22-4407-9c60-a2aae1a4a56c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f757c54a-dea3-4f2a-a99f-5df57cc050b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Creating offline snapshot 239a36da-dd8b-45bb-b29c-ff592603b5b5 of volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:45:19 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Volume volume-d565f513-3b22-4407-9c60-a2aae1a4a56c (d565f513-3b22-4407-9c60-a2aae1a4a56c): created successfully Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f757c54a-dea3-4f2a-a99f-5df57cc050b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Flow 'volume_create_manager' (80d56e6c-36f1-4eb3-8a54-3f3744f36af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[81adb05e-a361-423c-bdd0-6f589126ab2f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:19 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b0f58c66-4b5e-49a8-ad37-bd28ad6ae69e tempest-VolumesTestJSON-1247494232 None] Created volume successfully. Apr 13 09:45:19 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:19 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:19 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.491s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:19 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 1G Apr 13 09:45:19 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Flow 'volume_create_manager' (bdb2665f-e225-4da1-99ad-75deb3a27bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92256cf0-f354-4d44-b44f-3be3f580df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92256cf0-f354-4d44-b44f-3be3f580df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1159393920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f628267-289a-4090-a8f1-5fb39a367795,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32999d5960b54d10a48e69f32b3c9bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:20Z,use_quota=True,user_id='bfccd241472d444a9f07dad4e7a0cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e288b2-5336-47e4-8fab-e977dac5381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e288b2-5336-47e4-8fab-e977dac5381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb8de51-310d-40f3-a946-3f3cda083257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb8de51-310d-40f3-a946-3f3cda083257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f628267-289a-4090-a8f1-5fb39a367795', 'volume_name': 'volume-3f628267-289a-4090-a8f1-5fb39a367795', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4716d6-5b8b-4460-92d4-99128093d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4716d6-5b8b-4460-92d4-99128093d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424630aa-cefc-47b0-9666-cdf2bcb7b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:20 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Volume 3f628267-289a-4090-a8f1-5fb39a367795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f628267-289a-4090-a8f1-5fb39a367795', 'volume_size': 1} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:20 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 1G" returned: 0 in 0.498s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:20 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:20 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:20 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.422s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:20 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 is being set with open permissions: ugo+rw Apr 13 09:45:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:20 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:20 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:21 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.401s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.081s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1307680287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0eb0d7-6456-47a4-b3ff-7f9f18508667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f33447752348f8bf70c2420088407c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:06Z,use_quota=True,user_id='e73ba7a33d4c46e9bb80a15e5c7c4afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Creating volume 6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:21 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:21 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 1073741824 Apr 13 09:45:21 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-620435d9-c2c9-4cf4-9e33-4a2469f14544 tempest-VolumesSnapshotListTestJSON-1738204307 None] Create snapshot completed successfully Apr 13 09:45:21 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 1073741824" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:21 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:21 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:22 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.694s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793f3d7-080b-45a8-b2ca-a33fa345f7bd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Attempting download of 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume 6a0eb0d7-6456-47a4-b3ff-7f9f18508667. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[933cd5e9-0c02-4ef4-b500-1d34b4eb5950]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:22 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:22 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:22 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm Apr 13 09:45:22 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:22 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.474s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674ef86-7607-424f-b4fa-98e87bf0a43d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:22 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm" returned: 0 in 0.476s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:22 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:22 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:22 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm Apr 13 09:45:22 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:23 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:23 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img Apr 13 09:45:23 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:23 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm" returned: 1 in 0.506s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_kehgxwfm' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:45:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f05f9-8e34-4721-aa9a-e89b292da1d4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:23 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD Apr 13 09:45:23 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:23 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:24 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] 168ef6f7-3a65-468d-bd46-416aedea31b3 was qcow2, converting to raw {{(pid=82295) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 09:45:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:24 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:24 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:25 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img" returned: 0 in 2.249s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:25 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d214ab-2d5a-4ec3-b08b-cae877e0d246]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:25 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:25 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:25 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 0 in 1.719s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:25 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_rftl6_1edevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:45:25 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Converted 112.00 MB image at 65.11 MB/s Apr 13 09:45:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:25 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 1G Apr 13 09:45:25 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:26 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.613s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:45:26 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Converted 1024.00 MB image at 455.08 MB/s Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] b74051eb-2b61-4e80-99d3-10a00b159034 was raw, converting to qcow2 {{(pid=82295) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5e246-e6c2-406b-a661-480fde12ff18]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:26 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 1G" returned: 0 in 0.467s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af67700-79d8-4944-b359-27e8ebbe276a]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:26 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img Apr 13 09:45:26 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:26 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:26 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:26 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:26 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img Apr 13 09:45:26 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:26 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 0 in 0.486s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:26 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:26 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:27 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img" returned: 1 in 0.468s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img /opt/stack/data/cinder/conversion/vol_upload_3tb757n6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:27 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img /opt/stack/data/cinder/conversion/vol_upload_3tb757n6 Apr 13 09:45:27 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:27 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 1 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Downloaded image 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume 6a0eb0d7-6456-47a4-b3ff-7f9f18508667 successfully. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 for user e73ba7a33d4c46e9bb80a15e5c7c4afb is deleted. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Marking volume 6a0eb0d7-6456-47a4-b3ff-7f9f18508667 as bootable. {{(pid=82295) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Copying metadata from image 168ef6f7-3a65-468d-bd46-416aedea31b3 to 6a0eb0d7-6456-47a4-b3ff-7f9f18508667. {{(pid=82295) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Creating volume glance metadata for volume 6a0eb0d7-6456-47a4-b3ff-7f9f18508667 backed by image 168ef6f7-3a65-468d-bd46-416aedea31b3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82295) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4697078-92b0-4d81-9243-7cf83a7a1dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d696e584-1998-4b47-a24c-a68b36f33506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Volume volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 (6a0eb0d7-6456-47a4-b3ff-7f9f18508667): created successfully Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d696e584-1998-4b47-a24c-a68b36f33506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Flow 'volume_create_manager' (27be29a1-4e91-4935-9f25-4779ae742b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d9a2d8ad-4d05-4333-a4b4-0abb204f3fea tempest-VolumesExtendTest-143110263 None] Created volume successfully. Apr 13 09:45:27 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img /opt/stack/data/cinder/conversion/vol_upload_3tb757n6" returned: 0 in 0.410s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Image conversion details: src /opt/stack/data/cinder/conversion/e360e811-2161-4de3-9605-fc311a3807a8.temp_image.b74051eb-2b61-4e80-99d3-10a00b159034bmolrrnl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3tb757n6 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:45:27 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ce24d-d876-45a9-8ab8-d22cc0498cff]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3tb757n6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:27 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3tb757n6 Apr 13 09:45:27 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:27 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3tb757n6" returned: 0 in 0.475s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.659s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Uploaded volume to glance image-id: b74051eb-2b61-4e80-99d3-10a00b159034. {{(pid=82295) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.793s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1159393920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f628267-289a-4090-a8f1-5fb39a367795,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32999d5960b54d10a48e69f32b3c9bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:20Z,use_quota=True,user_id='bfccd241472d444a9f07dad4e7a0cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Creating volume 3f628267-289a-4090-a8f1-5fb39a367795 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:28 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:28 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 1073741824 Apr 13 09:45:28 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f13fd925-394a-4cc1-83a8-754262b464ca tempest-VolumesActionsTest-1436460640 None] Copy volume to image completed successfully. Apr 13 09:45:29 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 1073741824" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:29 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 Apr 13 09:45:29 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:29 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795" returned: 0 in 0.423s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424630aa-cefc-47b0-9666-cdf2bcb7b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f628267-289a-4090-a8f1-5fb39a367795', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4aadad-6ec7-4ed4-b7cb-a7e19de835ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Creating offline snapshot c564f737-e65b-4eb6-97ff-b2b06f1250f8 of volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:45:29 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Volume volume-3f628267-289a-4090-a8f1-5fb39a367795 (3f628267-289a-4090-a8f1-5fb39a367795): created successfully Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4aadad-6ec7-4ed4-b7cb-a7e19de835ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Flow 'volume_create_manager' (bdb2665f-e225-4da1-99ad-75deb3a27bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514a9a6-b904-4a47-9099-ab1c0ca5ac50]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-775c506b-b864-4238-9d4b-51a40fcfb274 tempest-VolumesTestJSON-1247494232 None] Created volume successfully. Apr 13 09:45:29 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:29 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Acquiring lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Acquiring lock "cinder-quobyte-e360e811-2161-4de3-9605-fc311a3807a8" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Lock "cinder-quobyte-e360e811-2161-4de3-9605-fc311a3807a8" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d212911-f758-40f3-8fc5-32892910b766]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:30 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:30 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:30 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:30 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 1G Apr 13 09:45:30 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:30 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.504s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:30 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8 Apr 13 09:45:30 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:30 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 1G" returned: 0 in 0.574s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:31 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 Apr 13 09:45:31 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Flow 'volume_create_manager' (85da980c-e2b4-4301-8010-929265e0a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725889cf-7d3a-4764-ba9b-5e84bbf46ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725889cf-7d3a-4764-ba9b-5e84bbf46ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-740336076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f79f94-e3ad-422c-b1f1-9498f89ad02e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32999d5960b54d10a48e69f32b3c9bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:31Z,use_quota=True,user_id='bfccd241472d444a9f07dad4e7a0cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f377f10-9f12-4365-8b2c-11d15c0d4395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f377f10-9f12-4365-8b2c-11d15c0d4395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f4da7-3772-4f7a-8cfb-f4aae370459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272f4da7-3772-4f7a-8cfb-f4aae370459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f79f94-e3ad-422c-b1f1-9498f89ad02e', 'volume_name': 'volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e072e459-a9ba-4f35-9c89-23604bbee5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e072e459-a9ba-4f35-9c89-23604bbee5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c5c3e8-c770-4da3-9090-7f5ef45be1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:31 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Volume 29f79f94-e3ad-422c-b1f1-9498f89ad02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e', 'volume_size': 1} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:31 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e360e811-2161-4de3-9605-fc311a3807a8" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Lock "cinder-quobyte-e360e811-2161-4de3-9605-fc311a3807a8" released by "delete_volume" :: held 0.966s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Created reservations ['6a335254-9282-498d-ba95-6aca10a6f046', 'b6230d9f-03cc-452c-91e2-fb259c825fe8', 'f9e4aa38-e5ac-4e21-8dfb-9743ef288ab2', 'ef11fe30-578c-4680-89e6-2ff173c7a1b2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:31 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:31 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:31 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8" returned: 0 in 0.468s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:31 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 is being set with open permissions: ugo+rw Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:31 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 Apr 13 09:45:31 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:31 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.429s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Deleted volume successfully. Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0e376062-b9e7-45a3-8838-23dff3b0729c tempest-VolumesActionsTest-1436460640 None] Lock "cinder-e360e811-2161-4de3-9605-fc311a3807a8-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:31 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8" returned: 0 in 0.422s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.724s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea98bfc-af8f-42c2-8c3d-602d5749f6ea]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9e2cede1-62b4-4947-9d89-9f9cf0e86a03 tempest-VolumesSnapshotListTestJSON-1738204307 None] Create snapshot completed successfully Apr 13 09:45:32 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:32 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:32 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:32 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:32 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-c564f737-e65b-4eb6-97ff-b2b06f1250f8-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-c564f737-e65b-4eb6-97ff-b2b06f1250f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-c564f737-e65b-4eb6-97ff-b2b06f1250f8" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-c564f737-e65b-4eb6-97ff-b2b06f1250f8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Deleting offline snapshot c564f737-e65b-4eb6-97ff-b2b06f1250f8 of volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] snapshot_file for this snap is: volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d1cad-7e50-416a-9a02-7023eba48f20]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:33 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 Apr 13 09:45:33 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:33 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 1 in 0.575s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 2G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 2G" returned: 0 in 0.034s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.206s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-740336076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f79f94-e3ad-422c-b1f1-9498f89ad02e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32999d5960b54d10a48e69f32b3c9bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:31Z,use_quota=True,user_id='bfccd241472d444a9f07dad4e7a0cd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Creating volume 29f79f94-e3ad-422c-b1f1-9498f89ad02e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:33 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:33 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e 1073741824 Apr 13 09:45:33 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:33 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c3bd547e-a404-4f0f-96de-7fc2d9ae20ac tempest-VolumesExtendTest-143110263 None] Extend volume completed successfully. Apr 13 09:45:33 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc70987-c4bc-43d6-9ea6-8054110b048e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:33 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:33 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-6a0eb0d7-6456-47a4-b3ff-7f9f18508667-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Lock "cinder-6a0eb0d7-6456-47a4-b3ff-7f9f18508667-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:33 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e 1073741824" returned: 0 in 0.567s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-quobyte-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f287ee31-4954-4ff8-8777-c5582d1cfc32]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:33 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e Apr 13 09:45:33 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:33 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:33 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:34 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.715s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:34 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 Apr 13 09:45:34 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:34 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 0 in 0.547s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:34 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e" returned: 0 in 0.582s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=110,cinder:INSERT=44,cinder:UPDATE=89,cinder:DELETE=11 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c5c3e8-c770-4da3-9090-7f5ef45be1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2f88b4-fa39-41cd-b723-f2cf19af060c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:INSERT=27,cinder:SELECT=84,cinder:UPDATE=122,cinder:DELETE=9 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:45:34 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Volume volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e (29f79f94-e3ad-422c-b1f1-9498f89ad02e): created successfully Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2f88b4-fa39-41cd-b723-f2cf19af060c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Flow 'volume_create_manager' (85da980c-e2b4-4301-8010-929265e0a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6e0a0366-030b-4bbc-af9b-8cebd7a6e2f6 tempest-VolumesTestJSON-1247494232 None] Created volume successfully. Apr 13 09:45:34 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:34 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:34 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8" returned: 0 in 0.613s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:34 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8 Apr 13 09:45:34 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:35 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 1 in 0.668s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:35 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667 Apr 13 09:45:35 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:35 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.c564f737-e65b-4eb6-97ff-b2b06f1250f8" returned: 0 in 0.538s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-c564f737-e65b-4eb6-97ff-b2b06f1250f8" released by "_delete_snapshot" :: held 2.414s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" released by "delete_snapshot" :: held 2.428s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Created reservations ['2f199428-563b-495e-9d2d-c335f0e0321b', '54a7071a-fbbb-47d5-a828-5a2433a6d5ee', 'e736dcb2-01eb-4669-8ab5-6dc5b89de5a2', 'abc7127a-4c43-45c1-86a8-29d430da2be3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:35 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Delete snapshot completed successfully. Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5162cae4-0649-4def-8eb6-fe3a36b410cd tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-c564f737-e65b-4eb6-97ff-b2b06f1250f8-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:35 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" returned: 0 in 0.485s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-6a0eb0d7-6456-47a4-b3ff-7f9f18508667" released by "delete_volume" :: held 1.741s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Created reservations ['301e9989-7b31-4439-aef8-27927fbbd964', '1861b5f8-193a-4410-b536-03999731a79c', '1585d3cf-8822-46e7-afbc-2dcbbd2431db', 'ffa327e2-f0fe-4e50-bb96-73764f2eb0ec'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:35 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:35 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Flow 'volume_create_manager' (92c5a1d9-c1ad-4f4d-986a-a212d16ef39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d5ed67-517e-4190-afaf-d1902095cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d5ed67-517e-4190-afaf-d1902095cf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1395280317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b26cd6-ebbc-4090-b753-42ac3248a69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1678c97a1719491c9f70d9d32ca25b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:36Z,use_quota=True,user_id='871b3ed520c74282b755c1df45efebc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfffafda-2078-4c7d-b8b6-79b82a81bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:35 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfffafda-2078-4c7d-b8b6-79b82a81bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70292602-0c97-4bc6-bd55-740a9c591240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70292602-0c97-4bc6-bd55-740a9c591240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b26cd6-ebbc-4090-b753-42ac3248a69e', 'volume_name': 'volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e', 'volume_size': 2}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf30114-f515-4024-973e-15a1fecd66cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf30114-f515-4024-973e-15a1fecd66cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b8346a-b392-404d-accb-a40708550b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Volume b0b26cd6-ebbc-4090-b753-42ac3248a69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e', 'volume_size': 2} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1395280317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b26cd6-ebbc-4090-b753-42ac3248a69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1678c97a1719491c9f70d9d32ca25b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:36Z,use_quota=True,user_id='871b3ed520c74282b755c1df45efebc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Creating volume b0b26cd6-ebbc-4090-b753-42ac3248a69e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:36 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e 2147483648 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:36 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.499s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:36 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e 2147483648 Apr 13 09:45:36 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Deleted volume successfully. Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-239a36da-dd8b-45bb-b29c-ff592603b5b5-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-239a36da-dd8b-45bb-b29c-ff592603b5b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9d806576-1876-4528-99b5-292b380699ef tempest-VolumesExtendTest-143110263 None] Lock "cinder-6a0eb0d7-6456-47a4-b3ff-7f9f18508667-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-239a36da-dd8b-45bb-b29c-ff592603b5b5" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-239a36da-dd8b-45bb-b29c-ff592603b5b5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Deleting offline snapshot 239a36da-dd8b-45bb-b29c-ff592603b5b5 of volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] snapshot_file for this snap is: volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a2f25-2b3b-48c8-aa66-f054c687ecb0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Flow 'volume_create_manager' (073b738b-1fc5-4088-a771-d563f772ec6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45fa745-bab3-4e50-be3b-6993ab2edb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Acquiring lock "cinder-29f79f94-e3ad-422c-b1f1-9498f89ad02e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:36 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:36 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45fa745-bab3-4e50-be3b-6993ab2edb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-978185720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c343965-a854-424b-8c96-99cb170bd745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f33447752348f8bf70c2420088407c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:36Z,use_quota=True,user_id='e73ba7a33d4c46e9bb80a15e5c7c4afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863ce15-674f-4599-95d9-055ac7144b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863ce15-674f-4599-95d9-055ac7144b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b278e7-4d49-43ff-8928-cb5bbed16a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b278e7-4d49-43ff-8928-cb5bbed16a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c343965-a854-424b-8c96-99cb170bd745', 'volume_name': 'volume-0c343965-a854-424b-8c96-99cb170bd745', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7103ead6-04f0-4ce2-ad44-a5822f22002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7103ead6-04f0-4ce2-ad44-a5822f22002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f266d75-ddc7-472d-8fd5-a6d7aff889f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:36 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Volume 0c343965-a854-424b-8c96-99cb170bd745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c343965-a854-424b-8c96-99cb170bd745', 'volume_size': 1} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Lock "cinder-29f79f94-e3ad-422c-b1f1-9498f89ad02e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Acquiring lock "cinder-quobyte-29f79f94-e3ad-422c-b1f1-9498f89ad02e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Lock "cinder-quobyte-29f79f94-e3ad-422c-b1f1-9498f89ad02e" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ba862f-8544-4886-ade9-f83a674718b4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:36 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e Apr 13 09:45:36 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:36 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e 2147483648" returned: 0 in 0.626s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:36 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e Apr 13 09:45:36 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:36 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6250c9d0-7bed-426e-8eb4-a9f9ad9b8550]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:36 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:36 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:36 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e" returned: 0 in 0.484s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:36 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e Apr 13 09:45:36 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:37 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e" returned: 0 in 0.421s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-978185720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c343965-a854-424b-8c96-99cb170bd745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f33447752348f8bf70c2420088407c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:36Z,use_quota=True,user_id='e73ba7a33d4c46e9bb80a15e5c7c4afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Creating volume 0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:37 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b8346a-b392-404d-accb-a40708550b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e', 'volume_size': 2}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdce04a3-a819-4670-adad-be8cfcb97e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:37 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 1073741824 Apr 13 09:45:37 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:37 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Volume volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e (b0b26cd6-ebbc-4090-b753-42ac3248a69e): created successfully Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdce04a3-a819-4670-adad-be8cfcb97e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Flow 'volume_create_manager' (92c5a1d9-c1ad-4f4d-986a-a212d16ef39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-241ffe04-dc91-4c4b-b747-d212d3ea10db tempest-VolumesCloneNegativeTest-1899046675 None] Created volume successfully. Apr 13 09:45:37 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.499s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:37 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:37 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:37 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-29f79f94-e3ad-422c-b1f1-9498f89ad02e" returned: 0 in 0.466s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Lock "cinder-quobyte-29f79f94-e3ad-422c-b1f1-9498f89ad02e" released by "delete_volume" :: held 0.970s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Created reservations ['04813867-f748-416e-a273-d5f2119f8791', '1921d3c0-27d7-4189-bbb4-eb667163a10d', '39fe6a44-4f71-4177-9b76-44b0f6d32f24', 'fde2768b-cc7f-45cd-9f7b-c620ded2bafd'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:37 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:37 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:37 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 1073741824" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:37 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 Apr 13 09:45:37 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:37 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.523s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:37 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5 Apr 13 09:45:37 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:37 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Deleted volume successfully. Apr 13 09:45:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f3e158b5-74b9-4ea1-97f2-182b8c49dcce tempest-VolumesTestJSON-1247494232 None] Lock "cinder-29f79f94-e3ad-422c-b1f1-9498f89ad02e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:38 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745" returned: 0 in 0.449s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Acquiring lock "cinder-b0b26cd6-ebbc-4090-b753-42ac3248a69e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f266d75-ddc7-472d-8fd5-a6d7aff889f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c343965-a854-424b-8c96-99cb170bd745', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866f136c-455f-4e7d-8466-ecb790dc86c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:38 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Volume volume-0c343965-a854-424b-8c96-99cb170bd745 (0c343965-a854-424b-8c96-99cb170bd745): created successfully Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866f136c-455f-4e7d-8466-ecb790dc86c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Flow 'volume_create_manager' (073b738b-1fc5-4088-a771-d563f772ec6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Lock "cinder-b0b26cd6-ebbc-4090-b753-42ac3248a69e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d4b2aac4-1215-466d-9ded-57bea5e7c2a3 tempest-VolumesExtendTest-143110263 None] Created volume successfully. Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Acquiring lock "cinder-quobyte-b0b26cd6-ebbc-4090-b753-42ac3248a69e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Lock "cinder-quobyte-b0b26cd6-ebbc-4090-b753-42ac3248a69e" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a99ba3-914e-478d-b561-f0de057ad402]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:38 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.239a36da-dd8b-45bb-b29c-ff592603b5b5" returned: 0 in 0.466s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-239a36da-dd8b-45bb-b29c-ff592603b5b5" released by "_delete_snapshot" :: held 2.113s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" released by "delete_snapshot" :: held 2.128s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Created reservations ['b5fb3a3f-5c34-4172-8288-7c85a0c24457', 'c4606b30-d3e1-42f1-b7f4-7f5fa382ec71', '0db30e8f-dff9-441a-86ab-2f44d18e231e', '6e77d203-05e0-4ce1-b0e2-557261ef6352'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:38 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e Apr 13 09:45:38 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Delete snapshot completed successfully. Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9366782f-7af1-4639-832e-c7ed486548f9 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-239a36da-dd8b-45bb-b29c-ff592603b5b5-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "cinder-3f628267-289a-4090-a8f1-5fb39a367795-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-3f628267-289a-4090-a8f1-5fb39a367795-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "cinder-quobyte-3f628267-289a-4090-a8f1-5fb39a367795" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-quobyte-3f628267-289a-4090-a8f1-5fb39a367795" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a0ced-ef33-4f6e-89c8-29b27eedbf32]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Creating offline snapshot 53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb of volume 0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ea19e-8449-4430-8c86-0bfa2bafa43a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:38 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 Apr 13 09:45:38 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:38 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 Apr 13 09:45:38 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:38 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e" returned: 0 in 0.568s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:38 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e Apr 13 09:45:38 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:38 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795" returned: 0 in 0.495s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:38 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795 Apr 13 09:45:38 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:38 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:38 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb 1G Apr 13 09:45:38 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:39 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b0b26cd6-ebbc-4090-b753-42ac3248a69e" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Lock "cinder-quobyte-b0b26cd6-ebbc-4090-b753-42ac3248a69e" released by "delete_volume" :: held 1.053s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-40d443c4-ded1-4959-a43e-34e13f82eb5c-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Created reservations ['c88f66d3-5ba0-401a-9ca4-dba568e174e9', '8ef80b96-a94f-4ce7-bf4d-b967571a8808', 'b5f0158f-74ce-48d7-805d-bcb63b7a2764', 'c7aa44fa-84ad-41b9-8d7d-9e254fa514f3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-40d443c4-ded1-4959-a43e-34e13f82eb5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-40d443c4-ded1-4959-a43e-34e13f82eb5c" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-40d443c4-ded1-4959-a43e-34e13f82eb5c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Deleting offline snapshot 40d443c4-ded1-4959-a43e-34e13f82eb5c of volume fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] snapshot_file for this snap is: volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c9d72a-2333-4eef-b54e-1e5059eb5ca1]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:39 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:39 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:39 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3f628267-289a-4090-a8f1-5fb39a367795" returned: 0 in 0.522s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-quobyte-3f628267-289a-4090-a8f1-5fb39a367795" released by "delete_volume" :: held 1.056s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:39 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:39 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Created reservations ['b26bb11c-6522-41d8-8e44-80faa2b6829d', 'f7d87520-845e-4ee6-ac40-a6a7698d707e', 'cd846645-7543-4fa3-872d-30370a383cfb', 'a63f900e-7b1a-4276-a069-e167fce01685'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:39 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb 1G" returned: 0 in 0.595s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c343965-a854-424b-8c96-99cb170bd745 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:39 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:39 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:39 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c343965-a854-424b-8c96-99cb170bd745 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb Apr 13 09:45:39 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:39 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:39 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Deleted volume successfully. Apr 13 09:45:39 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.554s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf61d95-92db-4ab2-ba29-c400005a1c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be85c4df-e2b2-40ed-bc52-df5913a4cae3 tempest-VolumesCloneNegativeTest-1899046675 None] Lock "cinder-b0b26cd6-ebbc-4090-b753-42ac3248a69e-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e0b626-74bc-4e82-a986-8d576413f990]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:40 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 Apr 13 09:45:40 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:40 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.475s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Deleted volume successfully. Apr 13 09:45:40 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c343965-a854-424b-8c96-99cb170bd745 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" returned: 0 in 0.475s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:40 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb is being set with open permissions: ugo+rw Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d2b1afbf-ae9f-49ff-bbbf-4474707314f4 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-3f628267-289a-4090-a8f1-5fb39a367795-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:40 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb Apr 13 09:45:40 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:40 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35" returned: 0 in 0.528s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:40 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:40 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:40 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" returned: 0 in 0.456s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:40 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info Apr 13 09:45:40 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "cinder-d565f513-3b22-4407-9c60-a2aae1a4a56c-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-d565f513-3b22-4407-9c60-a2aae1a4a56c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "cinder-quobyte-d565f513-3b22-4407-9c60-a2aae1a4a56c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-quobyte-d565f513-3b22-4407-9c60-a2aae1a4a56c" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[423ce540-0b18-42b8-9ae6-2e86377e4188]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:40 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c Apr 13 09:45:40 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:40 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.531s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:41 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c Apr 13 09:45:41 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:41 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info" returned: 0 in 0.594s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:41 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info is being set with open permissions: ugo+rw Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:41 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info Apr 13 09:45:41 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:41 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c" returned: 0 in 0.572s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:41 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c Apr 13 09:45:41 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:41 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35.40d443c4-ded1-4959-a43e-34e13f82eb5c" returned: 0 in 0.474s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-40d443c4-ded1-4959-a43e-34e13f82eb5c" released by "_delete_snapshot" :: held 2.165s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" released by "delete_snapshot" :: held 2.190s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Created reservations ['6f070ecb-ec9a-44ff-900b-9e55e8a9640d', '56660827-2ce5-4d8d-bdc9-af61f6ae4820', 'a30e7377-4709-496c-95ca-ea956165f9b4', '24fb3d6a-eab6-49a4-b5c1-493611052ccf'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:41 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Delete snapshot completed successfully. Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3a92d305-6457-4de3-8325-dc0568d89591 tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-40d443c4-ded1-4959-a43e-34e13f82eb5c-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:41 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.info" returned: 0 in 0.514s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:41 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ce286ab0-944a-4dec-9606-29519ded8316 tempest-VolumesExtendTest-143110263 None] Create snapshot completed successfully Apr 13 09:45:41 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d565f513-3b22-4407-9c60-a2aae1a4a56c" returned: 0 in 0.504s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-quobyte-d565f513-3b22-4407-9c60-a2aae1a4a56c" released by "delete_volume" :: held 1.096s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Created reservations ['265788c8-a5e7-4100-9770-0944c0bedaaf', 'a10d1088-0d08-4c24-a3c1-1c7491591180', '4edb03fb-242a-4464-be7c-fb8d799d144e', 'fb05aad6-1f6b-4e69-ae74-7706dd949abc'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:41 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:41 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (116be96c-dc85-407c-a05b-3e5ca97e66d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefce32e-324b-4fe8-8e20-5bb28780c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefce32e-324b-4fe8-8e20-5bb28780c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1828201076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48105e03-cb6f-44d1-ac8d-d8f55a555f04,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:42Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2909b30-8d96-44c2-93fc-f650bd048ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2909b30-8d96-44c2-93fc-f650bd048ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b884f4-2613-4783-a7db-972ea0ecb592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b884f4-2613-4783-a7db-972ea0ecb592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48105e03-cb6f-44d1-ac8d-d8f55a555f04', 'volume_name': 'volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19556931-08d4-419f-bf43-bda0ee120d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19556931-08d4-419f-bf43-bda0ee120d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e83b67-3295-4760-9922-146cc0a40182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:42 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Volume 48105e03-cb6f-44d1-ac8d-d8f55a555f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04', 'volume_size': 1} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1828201076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48105e03-cb6f-44d1-ac8d-d8f55a555f04,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:42Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Creating volume 48105e03-cb6f-44d1-ac8d-d8f55a555f04 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:42 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:42 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 1073741824 Apr 13 09:45:42 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:42 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.411s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:42 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Deleted volume successfully. Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8ceb3d8d-c676-4eec-a8c2-82b27a1aecb6 tempest-VolumesTestJSON-1247494232 None] Lock "cinder-d565f513-3b22-4407-9c60-a2aae1a4a56c-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-fbf61d95-92db-4ab2-ba29-c400005a1c35-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-fbf61d95-92db-4ab2-ba29-c400005a1c35-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d7cba-11df-4796-b857-c9292ffe6f04]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:42 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 Apr 13 09:45:42 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:42 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 1073741824" returned: 0 in 0.518s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:42 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 Apr 13 09:45:42 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:43 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35" returned: 0 in 0.611s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:43 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35 Apr 13 09:45:43 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:43 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04" returned: 0 in 0.455s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.472s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e83b67-3295-4760-9922-146cc0a40182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202d82d2-6144-4d74-8ee2-689d0fbc67fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e0ed5-fcb5-4ebe-9e2a-0a05f3985679]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:43 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Volume volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 (48105e03-cb6f-44d1-ac8d-d8f55a555f04): created successfully Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202d82d2-6144-4d74-8ee2-689d0fbc67fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (116be96c-dc85-407c-a05b-3e5ca97e66d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:43 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-eda150ae-9ceb-4742-a126-52c0faa75415 tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:45:43 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 Apr 13 09:45:43 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:43 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fbf61d95-92db-4ab2-ba29-c400005a1c35" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-quobyte-fbf61d95-92db-4ab2-ba29-c400005a1c35" released by "delete_volume" :: held 1.210s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Created reservations ['b8f17a7d-8a41-4f13-85aa-e9691b235881', '23ec5a0e-471a-4822-8c8f-3f78959f78a5', 'fbc4bb41-b9aa-49bd-9829-156247654c63', '1e8d26f7-43e9-4d33-90a2-79b9752ed5c1'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:43 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:43 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745" returned: 0 in 0.589s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:43 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb 2G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb 2G" returned: 0 in 0.071s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.693s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:43 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d9701c72-f255-4aae-917e-11eba15dbe72 tempest-VolumesExtendTest-143110263 None] Extend volume completed successfully. Apr 13 09:45:44 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.459s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:44 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Deleted volume successfully. Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4ae92ad3-4944-4a2c-9338-3b59d72853ce tempest-VolumesSnapshotListTestJSON-1738204307 None] Lock "cinder-fbf61d95-92db-4ab2-ba29-c400005a1c35-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (8591e2dc-03e2-4071-9059-a11f45021af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c14f3c-37d7-4f72-8b6e-fbeadc6cdc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c14f3c-37d7-4f72-8b6e-fbeadc6cdc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2113458340',display_name='tempest-VolumesGetTest-Volume-452596807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451f0441-e266-4f55-ae70-fad3d015e172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:45Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052e297d-ab3f-4f06-a6c6-19cda06e03ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052e297d-ab3f-4f06-a6c6-19cda06e03ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0ab6c7-6a4d-484f-b435-f2296698536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0ab6c7-6a4d-484f-b435-f2296698536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451f0441-e266-4f55-ae70-fad3d015e172', 'volume_name': 'volume-451f0441-e266-4f55-ae70-fad3d015e172', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d250d390-dd5c-44dd-b86b-1cc48f44c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d250d390-dd5c-44dd-b86b-1cc48f44c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb3b916-cefa-4948-bca5-95067e1bc4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:44 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Volume 451f0441-e266-4f55-ae70-fad3d015e172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451f0441-e266-4f55-ae70-fad3d015e172', 'volume_size': 1} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2113458340',display_name='tempest-VolumesGetTest-Volume-452596807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451f0441-e266-4f55-ae70-fad3d015e172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:45Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Creating volume 451f0441-e266-4f55-ae70-fad3d015e172 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:44 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:44 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 1073741824 Apr 13 09:45:44 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Lock "cinder-53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-quobyte-0c343965-a854-424b-8c96-99cb170bd745" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-0c343965-a854-424b-8c96-99cb170bd745" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-quobyte-53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Deleting offline snapshot 53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb of volume 0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] snapshot_file for this snap is: volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6fffec-330f-4822-becb-14a10fdf1a80]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:45 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb Apr 13 09:45:45 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:45 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a08ae315-c062-41bd-8315-1b6e1c6e1c54 tempest-GroupSnapshotsTest-775201994 None] Group tempest-GroupSnapshotsTest-Group-1056400877: creating Apr 13 09:45:45 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a08ae315-c062-41bd-8315-1b6e1c6e1c54 tempest-GroupSnapshotsTest-775201994 None] Group tempest-GroupSnapshotsTest-Group-1056400877: created successfully Apr 13 09:45:45 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a08ae315-c062-41bd-8315-1b6e1c6e1c54 tempest-GroupSnapshotsTest-775201994 None] Create group completed successfully. Apr 13 09:45:45 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" returned: 0 in 0.602s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c343965-a854-424b-8c96-99cb170bd745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:45 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 1073741824" returned: 0 in 0.816s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be18dc-1fdd-4b6a-bc09-df7b9cbe1584]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:45 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 Apr 13 09:45:45 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:45 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 Apr 13 09:45:45 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:46 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172" returned: 0 in 0.472s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb3b916-cefa-4948-bca5-95067e1bc4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451f0441-e266-4f55-ae70-fad3d015e172', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba6e6d6-65b2-46c4-88c0-6ac22c6c1e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Volume volume-451f0441-e266-4f55-ae70-fad3d015e172 (451f0441-e266-4f55-ae70-fad3d015e172): created successfully Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba6e6d6-65b2-46c4-88c0-6ac22c6c1e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (8591e2dc-03e2-4071-9059-a11f45021af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:46 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745" returned: 0 in 0.546s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:46 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1165d05c-ddd5-4d7a-ab32-4104f83f91e3 tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:45:46 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb Apr 13 09:45:46 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (be75ba3d-7bdc-45a0-97b2-bd195e3b3295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d6c348-dfaf-4053-be1b-d97418a98980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d6c348-dfaf-4053-be1b-d97418a98980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929552594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8f962b3-102b-4fee-8950-7f7b5b1a20ec,host='devstack@QuobyteHD#QuobyteHD',id=d4971532-9d45-41b6-b058-0cca83c9ba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:47Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f15c62f1-630b-41f0-85ea-b00283b48f0d),volume_type_id=f15c62f1-630b-41f0-85ea-b00283b48f0d)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358bd17b-9b05-44ac-bf22-ffca6e326e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358bd17b-9b05-44ac-bf22-ffca6e326e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f03ef55-42ae-4f08-a034-5dbf10e43bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f03ef55-42ae-4f08-a034-5dbf10e43bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4971532-9d45-41b6-b058-0cca83c9ba31', 'volume_name': 'volume-d4971532-9d45-41b6-b058-0cca83c9ba31', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff06d10-3018-44d3-9a2d-ace679310ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff06d10-3018-44d3-9a2d-ace679310ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c802ee1e-9ebe-4210-b902-152d1c32fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Volume d4971532-9d45-41b6-b058-0cca83c9ba31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4971532-9d45-41b6-b058-0cca83c9ba31', 'volume_size': 1} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f8f962b3-102b-4fee-8950-7f7b5b1a20ec,created_at=2026-04-13T07:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929552594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8f962b3-102b-4fee-8950-7f7b5b1a20ec,host='devstack@QuobyteHD#QuobyteHD',id=d4971532-9d45-41b6-b058-0cca83c9ba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:47Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f15c62f1-630b-41f0-85ea-b00283b48f0d),volume_type_id=f15c62f1-630b-41f0-85ea-b00283b48f0d)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Creating volume d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:46 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:46 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 1073741824 Apr 13 09:45:46 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (4c3ae582-d0f8-4129-b5cd-dc003235eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4b170d-2554-4fbf-86e1-3198f911631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4b170d-2554-4fbf-86e1-3198f911631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713022375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64d21ce-8d27-48f9-a775-001d32e75a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:47Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0759de36-1459-49c8-8497-5014dc9a4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0759de36-1459-49c8-8497-5014dc9a4708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d10a282-2455-48b0-a881-8d75d9b99cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d10a282-2455-48b0-a881-8d75d9b99cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64d21ce-8d27-48f9-a775-001d32e75a08', 'volume_name': 'volume-a64d21ce-8d27-48f9-a775-001d32e75a08', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709f99aa-3fa6-4e7d-93b9-fd7842ef1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709f99aa-3fa6-4e7d-93b9-fd7842ef1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df622ec1-4be5-418f-bd16-11c3072733a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume a64d21ce-8d27-48f9-a775-001d32e75a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64d21ce-8d27-48f9-a775-001d32e75a08', 'volume_size': 1} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:46 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" returned: 0 in 0.615s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:46 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb Apr 13 09:45:46 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-451f0441-e266-4f55-ae70-fad3d015e172-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Lock "cinder-451f0441-e266-4f55-ae70-fad3d015e172-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-451f0441-e266-4f55-ae70-fad3d015e172" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-451f0441-e266-4f55-ae70-fad3d015e172" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f1b86e-4cb6-45ef-a128-8a9b54fb0a81]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:47 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 Apr 13 09:45:47 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:47 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 1073741824" returned: 0 in 0.572s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:47 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745.53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" returned: 0 in 0.465s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb" released by "_delete_snapshot" :: held 2.291s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-0c343965-a854-424b-8c96-99cb170bd745" released by "delete_snapshot" :: held 2.307s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:47 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:47 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172 Apr 13 09:45:47 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Created reservations ['282bb3e9-8e75-4c53-a75a-cc30aed5bca3', '3f6f6ccb-07b9-4de7-8292-35a02a0fce3e', '97853aae-7e5e-4b7d-8059-65ae59be134d', '47bbfed2-e112-4302-a80c-ccbd4ab482a1'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:47 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:45:47 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Delete snapshot completed successfully. Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0aee5fa3-0efd-4a23-8b81-da53f5fb541d tempest-VolumesExtendTest-143110263 None] Lock "cinder-53e14fae-e23f-49a7-bfc0-fb2f1c8a8cfb-delete_snapshot" released by "delete_snapshot" :: held 2.670s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:47 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-451f0441-e266-4f55-ae70-fad3d015e172" returned: 0 in 0.430s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-451f0441-e266-4f55-ae70-fad3d015e172" released by "delete_volume" :: held 0.966s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:47 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Created reservations ['f8c60ce4-e4a6-468a-8749-056122a3d9b8', '8a14f4b2-2e5b-4822-843a-8c2ad713ae83', '751fc062-80df-487f-82ae-07eacc06b28a', 'b93d1097-b2d5-476e-8d46-b54a4a15bcf3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:48 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.481s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:48 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:48 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713022375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64d21ce-8d27-48f9-a775-001d32e75a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:47Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating volume a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:48 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-48105e03-cb6f-44d1-ac8d-d8f55a555f04-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:48 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 1073741824 Apr 13 09:45:48 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c802ee1e-9ebe-4210-b902-152d1c32fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4971532-9d45-41b6-b058-0cca83c9ba31', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7136f8d-24c8-4cce-9fbc-ad85b89135af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-0c343965-a854-424b-8c96-99cb170bd745-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Lock "cinder-48105e03-cb6f-44d1-ac8d-d8f55a555f04-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:48 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Volume volume-d4971532-9d45-41b6-b058-0cca83c9ba31 (d4971532-9d45-41b6-b058-0cca83c9ba31): created successfully Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7136f8d-24c8-4cce-9fbc-ad85b89135af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (be75ba3d-7bdc-45a0-97b2-bd195e3b3295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Lock "cinder-0c343965-a854-424b-8c96-99cb170bd745-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-48105e03-cb6f-44d1-ac8d-d8f55a555f04" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3873ce1d-10fe-4e33-aa14-cbdfc89e2544 tempest-GroupSnapshotsTest-775201994 None] Created volume successfully. Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-48105e03-cb6f-44d1-ac8d-d8f55a555f04" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8614dd-3a42-4e8c-9f14-3e3611faad55]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Acquiring lock "cinder-quobyte-0c343965-a854-424b-8c96-99cb170bd745" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-0c343965-a854-424b-8c96-99cb170bd745" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[365753ff-a02a-4a5d-9be5-6bf8e0957ae0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 Apr 13 09:45:48 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 Apr 13 09:45:48 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.452s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee39054c-a7de-4bb7-b974-19bf907d970b tempest-VolumesGetTest-194080950 None] Lock "cinder-451f0441-e266-4f55-ae70-fad3d015e172-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:48 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 1073741824" returned: 0 in 0.552s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 Apr 13 09:45:48 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04" returned: 0 in 0.550s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04 Apr 13 09:45:48 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745" returned: 0 in 0.570s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:48 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745 Apr 13 09:45:48 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] GroupSnapshot a4f98004-69e7-4827-9118-13312499fda8: creating. Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Group snapshot a4f98004-69e7-4827-9118-13312499fda8: creating. {{(pid=82295) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 09:45:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:49 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08" returned: 0 in 0.469s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.166s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df622ec1-4be5-418f-bd16-11c3072733a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64d21ce-8d27-48f9-a775-001d32e75a08', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93768466-b63a-4df8-b571-fecbfafb853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Creating offline snapshot fb604788-6bf4-4c84-b58c-bfb2fb4d1363 of volume d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:45:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume volume-a64d21ce-8d27-48f9-a775-001d32e75a08 (a64d21ce-8d27-48f9-a775-001d32e75a08): created successfully Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93768466-b63a-4df8-b571-fecbfafb853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (4c3ae582-d0f8-4129-b5cd-dc003235eada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b645197d-3925-4bf2-9250-4f1beb386966]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-40df2d9f-da14-429d-af08-031b87acf6e0 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created volume successfully. Apr 13 09:45:49 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-48105e03-cb6f-44d1-ac8d-d8f55a555f04" returned: 0 in 0.486s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-48105e03-cb6f-44d1-ac8d-d8f55a555f04" released by "delete_volume" :: held 1.063s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:49 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:45:49 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Created reservations ['31a2f512-2028-40ed-84f3-a37fef33349b', 'c27c6a22-ecfc-4aad-aa95-5d45524dcd8b', '2b60790c-69a2-4422-9ddc-64a970f5693a', 'b11b56d2-5beb-4a6b-a9c5-1b4096db1c32'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:49 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c343965-a854-424b-8c96-99cb170bd745" returned: 0 in 0.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:49 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:49 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Lock "cinder-quobyte-0c343965-a854-424b-8c96-99cb170bd745" released by "delete_volume" :: held 1.122s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Created reservations ['def3b4df-4620-4803-8ada-3c6b57da55b7', '09706fcb-fa8c-4474-9b3b-51def9b372dd', '4f5a5fd8-88a6-40f9-856d-6b83b89098d5', 'a9ecb5cb-3832-4798-a6bb-b9f30237eb95'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:49 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:45:49 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:49 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.525s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:49 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 1G Apr 13 09:45:49 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:49 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e65a3fc3-6649-4f76-bfb8-efdd06900286 tempest-VolumesGetTest-194080950 None] Lock "cinder-48105e03-cb6f-44d1-ac8d-d8f55a555f04-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:49 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.441s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:45:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Deleted volume successfully. Apr 13 09:45:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-46b46f27-93d1-4ccb-bdfd-8b7be2405431 tempest-VolumesExtendTest-143110263 None] Lock "cinder-0c343965-a854-424b-8c96-99cb170bd745-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:50 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 1G" returned: 0 in 0.515s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4971532-9d45-41b6-b058-0cca83c9ba31 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:50 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4971532-9d45-41b6-b058-0cca83c9ba31 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 Apr 13 09:45:50 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (034e87bd-b23f-4d9c-8719-9035bf0bf50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72fd87e-2246-4b5a-a37b-a4e65445496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72fd87e-2246-4b5a-a37b-a4e65445496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461756374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c70c638-6f8d-4589-afa7-9fb7bf186f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:50Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69530ec-10b5-4493-9f3c-a34b68b76b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69530ec-10b5-4493-9f3c-a34b68b76b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048a4046-2d79-41b7-9683-e25164ba449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048a4046-2d79-41b7-9683-e25164ba449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'volume_name': 'volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179c29f2-5faa-41a9-bd27-439fb80aa9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179c29f2-5faa-41a9-bd27-439fb80aa9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46a11f-edf6-4f2d-96cf-f82544e4b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:50 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Volume 9c70c638-6f8d-4589-afa7-9fb7bf186f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'volume_size': 1} Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:50 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4971532-9d45-41b6-b058-0cca83c9ba31 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363" returned: 0 in 0.523s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:50 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:45:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:50 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 Apr 13 09:45:50 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:51 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363" returned: 0 in 0.483s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:51 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info Apr 13 09:45:51 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:51 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info" returned: 0 in 0.433s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:51 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:45:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:51 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info Apr 13 09:45:51 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Flow 'volume_create_manager' (bb12e1df-f929-49b3-8b56-e434ccbd3775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85206d6c-4bb6-41e3-98fb-f7435c4eaee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:52 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85206d6c-4bb6-41e3-98fb-f7435c4eaee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-702768558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4679ce01-31c0-4ba0-86e2-7d21d2c18902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003996c2127e4086b5930aee65c9c2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:52Z,use_quota=True,user_id='a3d24c9025824613afcea3fbd1cc97c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e583c7-af9b-41d7-bfb0-651b49aa003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e583c7-af9b-41d7-bfb0-651b49aa003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33923542-025f-488f-b7f7-667d24131109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33923542-025f-488f-b7f7-667d24131109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4679ce01-31c0-4ba0-86e2-7d21d2c18902', 'volume_name': 'volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902', 'volume_size': 2}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645f1b7e-421c-4052-8f9f-c9ce0f4ddbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645f1b7e-421c-4052-8f9f-c9ce0f4ddbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e027cbab-4738-442f-8fc4-5b4e29d6b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:52 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Volume 4679ce01-31c0-4ba0-86e2-7d21d2c18902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902', 'volume_size': 2} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.info" returned: 0 in 0.453s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.137s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating offline snapshot 02129cb3-20f0-41df-b145-a039c576a483 of volume a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8de2d-0778-43db-8a82-037a50c99038]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:52 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-68211d48-ffc9-4cb6-9043-faf885d0fafc tempest-GroupSnapshotsTest-775201994 None] group_snapshot a4f98004-69e7-4827-9118-13312499fda8: created successfully Apr 13 09:45:52 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 Apr 13 09:45:52 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:52 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:52 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 1G Apr 13 09:45:52 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:53 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 1G" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64d21ce-8d27-48f9-a775-001d32e75a08 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:53 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64d21ce-8d27-48f9-a775-001d32e75a08 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 Apr 13 09:45:53 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:53 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64d21ce-8d27-48f9-a775-001d32e75a08 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:53 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 is being set with open permissions: ugo+rw Apr 13 09:45:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:53 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 Apr 13 09:45:53 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:54 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483" returned: 0 in 0.454s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:54 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info Apr 13 09:45:54 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:54 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info" returned: 0 in 0.419s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:54 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info is being set with open permissions: ugo+rw Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:54 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info Apr 13 09:45:54 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:54 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.info" returned: 0 in 0.410s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461756374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c70c638-6f8d-4589-afa7-9fb7bf186f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:50Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Creating volume 9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:54 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:54 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 1073741824 Apr 13 09:45:54 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:54 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fc9c4dc7-19b8-4f48-a8bb-b5e48f9f7719 tempest-CreateVolumesFromSnapshotTest-635659478 None] Create snapshot completed successfully Apr 13 09:45:55 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 1073741824" returned: 0 in 0.498s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:55 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:45:55 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (45147080-1b53-4908-8ac1-2d29a13dcf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bca68b0-cc64-4ae6-accd-73788dce4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bca68b0-cc64-4ae6-accd-73788dce4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026481427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3f0108-0c20-4617-a0eb-0e6915930cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b319a58c-c47d-490d-9580-20eaaa937839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b319a58c-c47d-490d-9580-20eaaa937839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b40fd7a-fe38-4ce0-9cea-1e95128fc66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b40fd7a-fe38-4ce0-9cea-1e95128fc66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3f0108-0c20-4617-a0eb-0e6915930cec', 'volume_name': 'volume-0b3f0108-0c20-4617-a0eb-0e6915930cec', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3e0ca3-9ad1-4c20-8975-5b9cf8329e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3e0ca3-9ad1-4c20-8975-5b9cf8329e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4b312f-e940-4db8-b677-921c3ed2bb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume 0b3f0108-0c20-4617-a0eb-0e6915930cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3f0108-0c20-4617-a0eb-0e6915930cec', 'volume_size': 1} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (495209ad-bb38-4fba-bc66-087e2a64281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7a5e20-29e5-4968-b007-dddb732e5de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7a5e20-29e5-4968-b007-dddb732e5de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379557412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4af2add-fa66-4f16-a0e6-8178b925193e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f30ee6-342d-45bf-8b40-c28ba6bd2ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f30ee6-342d-45bf-8b40-c28ba6bd2ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065720b7-fbfb-4969-ac2d-57bca3d2f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065720b7-fbfb-4969-ac2d-57bca3d2f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4af2add-fa66-4f16-a0e6-8178b925193e', 'volume_name': 'volume-d4af2add-fa66-4f16-a0e6-8178b925193e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f9b26-7bb9-4955-a216-c539e16eedb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f9b26-7bb9-4955-a216-c539e16eedb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7eb1617-f96b-4663-b8e3-30af20181145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume d4af2add-fa66-4f16-a0e6-8178b925193e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4af2add-fa66-4f16-a0e6-8178b925193e', 'volume_size': 1} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:55 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.460s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.758s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-702768558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4679ce01-31c0-4ba0-86e2-7d21d2c18902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003996c2127e4086b5930aee65c9c2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:52Z,use_quota=True,user_id='a3d24c9025824613afcea3fbd1cc97c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Creating volume 4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:55 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 2147483648 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a46a11f-edf6-4f2d-96cf-f82544e4b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 2147483648 Apr 13 09:45:55 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6291dd4-95b0-4b67-ac1e-2b2196236286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:55 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Volume volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 (9c70c638-6f8d-4589-afa7-9fb7bf186f64): created successfully Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6291dd4-95b0-4b67-ac1e-2b2196236286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (034e87bd-b23f-4d9c-8719-9035bf0bf50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (69b2bd28-bbcd-49f0-91b0-d56f9bd37ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44cd70d-0b8a-452a-b710-b055131aebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6d75abda-f205-4f7d-a3fe-a8fa02844f56 tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44cd70d-0b8a-452a-b710-b055131aebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1357323700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae7e914-06af-4081-8565-f1717e7856b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cadfce1-a0f9-4dbd-9eff-61e00e429f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cadfce1-a0f9-4dbd-9eff-61e00e429f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49790779-a57e-4f3f-8587-5706532b2ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49790779-a57e-4f3f-8587-5706532b2ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae7e914-06af-4081-8565-f1717e7856b8', 'volume_name': 'volume-7ae7e914-06af-4081-8565-f1717e7856b8', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc2d875-dac1-4af1-8f7c-d06140d8254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc2d875-dac1-4af1-8f7c-d06140d8254d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df762bb5-7d81-4b1f-9185-567189664c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume 7ae7e914-06af-4081-8565-f1717e7856b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae7e914-06af-4081-8565-f1717e7856b8', 'volume_size': 1} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (a4d07a4f-6628-4935-9103-627edef71657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420572b5-796d-40c0-8293-104a63905db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420572b5-796d-40c0-8293-104a63905db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190054695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9160053f-d386-4691-bfa9-19253297c065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96b990f-f732-4547-9fb3-ae4debd0f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96b990f-f732-4547-9fb3-ae4debd0f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c705a7a3-3075-4e19-9e7a-cd37ef9e68a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c705a7a3-3075-4e19-9e7a-cd37ef9e68a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9160053f-d386-4691-bfa9-19253297c065', 'volume_name': 'volume-9160053f-d386-4691-bfa9-19253297c065', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c89955-a225-422b-83d1-22500be1d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c89955-a225-422b-83d1-22500be1d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b33636-ca62-4e77-a2f8-36713137a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume 9160053f-d386-4691-bfa9-19253297c065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9160053f-d386-4691-bfa9-19253297c065', 'volume_size': 1} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (d2c21c13-9ff8-4345-9e11-b665bd76dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ad5520-d636-422b-ae40-95e03e591464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ad5520-d636-422b-ae40-95e03e591464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096082958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de38566a-4983-4cc6-ae25-2a20be29f729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8e6cb1-0e34-42ca-97d2-ac62798e2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8e6cb1-0e34-42ca-97d2-ac62798e2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb3b868-e70d-4b0b-8d83-a7278a883303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb3b868-e70d-4b0b-8d83-a7278a883303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de38566a-4983-4cc6-ae25-2a20be29f729', 'volume_name': 'volume-de38566a-4983-4cc6-ae25-2a20be29f729', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b09f5e-864b-475a-98e3-f18cc64e4e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b09f5e-864b-475a-98e3-f18cc64e4e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f53c2b2-58e0-479a-b075-3e96b23e3dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:56 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume de38566a-4983-4cc6-ae25-2a20be29f729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de38566a-4983-4cc6-ae25-2a20be29f729', 'volume_size': 1} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:56 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 2147483648" returned: 0 in 0.615s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:56 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 Apr 13 09:45:56 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:56 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902" returned: 0 in 0.414s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.017s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-fb604788-6bf4-4c84-b58c-bfb2fb4d1363-d6162709-79d0-48af-ae9c-a236f1c85e2c" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e027cbab-4738-442f-8fc4-5b4e29d6b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902', 'volume_size': 2}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ee1d36-3c8f-4dc1-9149-afb7bf844236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:57 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Volume volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 (4679ce01-31c0-4ba0-86e2-7d21d2c18902): created successfully Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ee1d36-3c8f-4dc1-9149-afb7bf844236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Flow 'volume_create_manager' (bb12e1df-f929-49b3-8b56-e434ccbd3775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-fb604788-6bf4-4c84-b58c-bfb2fb4d1363-d6162709-79d0-48af-ae9c-a236f1c85e2c" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Creating volume d6162709-79d0-48af-ae9c-a236f1c85e2c from snapshot fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-d6162709-79d0-48af-ae9c-a236f1c85e2c" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:45:57 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-749e5540-b57c-4dba-b07b-9176d6fc10d8 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Created volume successfully. Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d6162709-79d0-48af-ae9c-a236f1c85e2c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] snapshot: fb604788-6bf4-4c84-b58c-bfb2fb4d1363, volume: d6162709-79d0-48af-ae9c-a236f1c85e2c, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[28969245-e76c-407a-967c-df62968f2430]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (12527f9c-9394-41e6-b9a4-9ed231d42b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e49ee0-c234-4894-92b2-1e7763337e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e49ee0-c234-4894-92b2-1e7763337e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1573961529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb43321-7dab-4355-b603-380aa6f64615,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9c70c638-6f8d-4589-afa7-9fb7bf186f64,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:57Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d74cc7-48d6-4057-a257-33261d496d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d74cc7-48d6-4057-a257-33261d496d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014ccb4b-87aa-45aa-9584-e574fe76d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:57 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 Apr 13 09:45:57 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014ccb4b-87aa-45aa-9584-e574fe76d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3fb43321-7dab-4355-b603-380aa6f64615', 'volume_name': 'volume-3fb43321-7dab-4355-b603-380aa6f64615', 'volume_size': 1, 'source_volid': '9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c854a66-e060-486b-870a-64e60af47dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c854a66-e060-486b-870a-64e60af47dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1433efe7-a05f-475e-ad45-dae17a320489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:45:57 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Volume 3fb43321-7dab-4355-b603-380aa6f64615: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3fb43321-7dab-4355-b603-380aa6f64615', 'volume_size': 1, 'source_volid': '9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'source_volstatus': 'available'} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:45:57 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363" returned: 0 in 0.495s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4971532-9d45-41b6-b058-0cca83c9ba31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85f9e4-6803-4bdf-a974-87ae2de6637e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:57 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:45:57 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:58 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:58 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:45:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:45:58 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c Apr 13 09:45:58 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:45:59 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 13 09:45:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c" returned: 0 in 1.918s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:45:59 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c41b54-ba48-4037-9444-015da6cd71c3]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:45:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:00 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:46:00 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:00 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:00 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:00 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.586s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:46:00 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Converted 1024.00 MB image at 533.56 MB/s Apr 13 09:46:00 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:00 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c Apr 13 09:46:00 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:00 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:00 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c" returned: 0 in 0.416s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d6162709-79d0-48af-ae9c-a236f1c85e2c" released by "_copy_volume_from_snapshot" :: held 3.950s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-fb604788-6bf4-4c84-b58c-bfb2fb4d1363-d6162709-79d0-48af-ae9c-a236f1c85e2c" released by "_create_volume_from_snapshot" :: held 3.976s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.013s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.349s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026481427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3f0108-0c20-4617-a0eb-0e6915930cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating volume 0b3f0108-0c20-4617-a0eb-0e6915930cec {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:01 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:01 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec 1073741824 Apr 13 09:46:01 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e93fab7c-ab05-47c3-a5e3-00e0f0698f57 tempest-GroupSnapshotsTest-775201994 None] Create group from source-snapshot-a4f98004-69e7-4827-9118-13312499fda8 completed successfully. Apr 13 09:46:01 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec 1073741824" returned: 0 in 0.483s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:01 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec Apr 13 09:46:01 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-d6162709-79d0-48af-ae9c-a236f1c85e2c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d6162709-79d0-48af-ae9c-a236f1c85e2c" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2462be-32c1-4926-b7f5-ec51f4b02b4c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:01 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec" returned: 0 in 0.437s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.117s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379557412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4af2add-fa66-4f16-a0e6-8178b925193e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating volume d4af2add-fa66-4f16-a0e6-8178b925193e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:01 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:01 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c Apr 13 09:46:01 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4b312f-e940-4db8-b677-921c3ed2bb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3f0108-0c20-4617-a0eb-0e6915930cec', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f818590-60a9-4c63-b8c9-bdb15e016c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:01 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e 1073741824 Apr 13 09:46:01 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:01 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume volume-0b3f0108-0c20-4617-a0eb-0e6915930cec (0b3f0108-0c20-4617-a0eb-0e6915930cec): created successfully Apr 13 09:46:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f818590-60a9-4c63-b8c9-bdb15e016c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (45147080-1b53-4908-8ac1-2d29a13dcf61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:02 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f51a7a3d-ea95-43d4-a358-666a27eb8f50 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created volume successfully. Apr 13 09:46:02 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c" returned: 0 in 0.529s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:02 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c Apr 13 09:46:02 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:02 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e 1073741824" returned: 0 in 0.510s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:02 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e Apr 13 09:46:02 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:02 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6162709-79d0-48af-ae9c-a236f1c85e2c" returned: 0 in 0.426s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d6162709-79d0-48af-ae9c-a236f1c85e2c" released by "delete_volume" :: held 0.978s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Created reservations ['f976ba0b-cdd8-4a39-8116-8e11afa10ff6'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:02 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:02 devstack cinder-volume[82295]: WARNING cinder.quota [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1902950925 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1902950925, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:02 devstack cinder-volume[82295]: WARNING cinder.quota [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1902950925 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1902950925, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e" returned: 0 in 0.428s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.885s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1357323700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae7e914-06af-4081-8565-f1717e7856b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating volume 7ae7e914-06af-4081-8565-f1717e7856b8 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:02 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7eb1617-f96b-4663-b8e3-30af20181145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4af2add-fa66-4f16-a0e6-8178b925193e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:02 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 1073741824 Apr 13 09:46:02 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bd94b8-cd00-43fa-825a-966bf212221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:02 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume volume-d4af2add-fa66-4f16-a0e6-8178b925193e (d4af2add-fa66-4f16-a0e6-8178b925193e): created successfully Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bd94b8-cd00-43fa-825a-966bf212221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (495209ad-bb38-4fba-bc66-087e2a64281f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:02 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Created reservations ['de0b64f0-3e1f-4414-8dce-a2c542b56714', '343cb439-f429-4440-9560-33fa93ada2d9', '4a9d24f2-ddef-4760-98db-0cb998315df0', 'ec53d7d3-39c6-4fc8-bc6c-b2e8423d2a4d'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-73b87173-dd47-49bb-acb4-7b837908b4a8 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created volume successfully. Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:03 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:03 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:03 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 1073741824" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:03 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 Apr 13 09:46:03 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:03 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.412s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0ed1937e-3e05-41c4-933b-a2b884b2598d tempest-GroupSnapshotsTest-775201994 None] Delete group completed successfully. Apr 13 09:46:03 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8" returned: 0 in 0.415s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.641s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190054695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9160053f-d386-4691-bfa9-19253297c065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating volume 9160053f-d386-4691-bfa9-19253297c065 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:03 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df762bb5-7d81-4b1f-9185-567189664c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae7e914-06af-4081-8565-f1717e7856b8', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:03 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 1073741824 Apr 13 09:46:03 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9612d76b-e1d7-458c-8e79-c21173baf3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:03 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume volume-7ae7e914-06af-4081-8565-f1717e7856b8 (7ae7e914-06af-4081-8565-f1717e7856b8): created successfully Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9612d76b-e1d7-458c-8e79-c21173baf3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (69b2bd28-bbcd-49f0-91b0-d56f9bd37ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-12b15411-a5d5-4196-8768-50e39b1cac63 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created volume successfully. Apr 13 09:46:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a4f98004-69e7-4827-9118-13312499fda8: deleting Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a4f98004-69e7-4827-9118-13312499fda8: deleting {{(pid=82295) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-d4971532-9d45-41b6-b058-0cca83c9ba31" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d4971532-9d45-41b6-b058-0cca83c9ba31" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-fb604788-6bf4-4c84-b58c-bfb2fb4d1363" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-fb604788-6bf4-4c84-b58c-bfb2fb4d1363" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Deleting offline snapshot fb604788-6bf4-4c84-b58c-bfb2fb4d1363 of volume d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] snapshot_file for this snap is: volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbecf4ce-228c-4b03-aab3-7a7d7752c093]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:04 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 Apr 13 09:46:04 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:04 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 1073741824" returned: 0 in 0.542s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:04 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 Apr 13 09:46:04 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:04 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363" returned: 0 in 0.498s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4971532-9d45-41b6-b058-0cca83c9ba31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5482bc-4ffb-4e1f-8acb-10b85ae9c1a4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:04 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:46:04 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:04 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065" returned: 0 in 0.410s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.412s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096082958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de38566a-4983-4cc6-ae25-2a20be29f729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f9064da5ae4a16b20b82309615e256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:45:56Z,use_quota=True,user_id='2f3b99133643468ab7f27f4c9561db96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Creating volume de38566a-4983-4cc6-ae25-2a20be29f729 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:04 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b33636-ca62-4e77-a2f8-36713137a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9160053f-d386-4691-bfa9-19253297c065', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:04 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 1073741824 Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14282a32-f91e-4b3c-81b1-454f13a44a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:04 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:04 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume volume-9160053f-d386-4691-bfa9-19253297c065 (9160053f-d386-4691-bfa9-19253297c065): created successfully Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14282a32-f91e-4b3c-81b1-454f13a44a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (a4d07a4f-6628-4935-9103-627edef71657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c4356108-c51f-44cd-a65e-efcb53ad679e tempest-CreateVolumesFromSnapshotTest-635659478 None] Created volume successfully. Apr 13 09:46:05 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:05 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 Apr 13 09:46:05 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:05 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 1073741824" returned: 0 in 0.542s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:05 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 Apr 13 09:46:05 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:05 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363" returned: 0 in 0.491s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:05 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363 Apr 13 09:46:05 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:05 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729" returned: 0 in 0.405s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.679s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:05 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Cloning volume 9c70c638-6f8d-4589-afa7-9fb7bf186f64 to volume 3fb43321-7dab-4355-b603-380aa6f64615 Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f53c2b2-58e0-479a-b075-3e96b23e3dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de38566a-4983-4cc6-ae25-2a20be29f729', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c9e1c4-b109-408f-aefe-0b4450d0e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:05 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Volume volume-de38566a-4983-4cc6-ae25-2a20be29f729 (de38566a-4983-4cc6-ae25-2a20be29f729): created successfully Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c9e1c4-b109-408f-aefe-0b4450d0e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Flow 'volume_create_manager' (d2c21c13-9ff8-4345-9e11-b665bd76dba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Creating offline snapshot 69a4f61d-e538-404c-9e6d-23b2ab1e7112 of volume 9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:05 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-af861d3e-2cb4-424e-ab06-1edbd88b7cf5 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created volume successfully. Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[00af4c52-bbba-4055-9731-d11681049d66]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:05 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:46:05 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:06 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31.fb604788-6bf4-4c84-b58c-bfb2fb4d1363" returned: 0 in 0.425s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-fb604788-6bf4-4c84-b58c-bfb2fb4d1363" released by "_delete_snapshot" :: held 1.953s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d4971532-9d45-41b6-b058-0cca83c9ba31" released by "delete_snapshot" :: held 1.967s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-de38566a-4983-4cc6-ae25-2a20be29f729-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-de38566a-4983-4cc6-ae25-2a20be29f729-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:06 devstack cinder-volume[82295]: WARNING cinder.quota [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1902950925 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1902950925, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-de38566a-4983-4cc6-ae25-2a20be29f729" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['87fccbc8-79f3-4e32-9ef3-e110e1654166', 'be9c9a1e-3d3d-498d-a228-0c0148225ab9', '075b2c89-cb88-42d9-b60b-ca69962a6d74', '22a28625-07f4-4bc9-a6d2-6d0312d457d6'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-de38566a-4983-4cc6-ae25-2a20be29f729" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1235b9-3ed2-4380-9862-5846f27a3caa]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:06 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ee27a6c3-e452-4454-9595-12f8a6f5f249 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a4f98004-69e7-4827-9118-13312499fda8: deleted successfully Apr 13 09:46:06 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 Apr 13 09:46:06 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:06 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:06 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 1G Apr 13 09:46:06 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:06 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729" returned: 0 in 0.496s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:06 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729 Apr 13 09:46:06 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:06 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 1G" returned: 0 in 0.504s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:06 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 Apr 13 09:46:06 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:07 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-de38566a-4983-4cc6-ae25-2a20be29f729" returned: 0 in 0.448s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-de38566a-4983-4cc6-ae25-2a20be29f729" released by "delete_volume" :: held 0.978s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['70e9524c-621f-4130-bc7e-39a5cb934281', 'dcaba8a8-f7c1-4f6e-8ae1-5b2db5e22f6c', 'd65b5351-79ba-44e1-a8ea-1e4ae835841c', '79c22c3c-e709-401b-b927-2dc5bb496494'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:07 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:07 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:07 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112" returned: 0 in 0.511s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:07 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 is being set with open permissions: ugo+rw Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:07 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 Apr 13 09:46:07 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-d4971532-9d45-41b6-b058-0cca83c9ba31" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d4971532-9d45-41b6-b058-0cca83c9ba31" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7af7c2-e573-41af-8e69-e0e6d71b0c49]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:07 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:46:07 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:07 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.483s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleted volume successfully. Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e4587b0b-86ac-43a1-9c63-c97bc3b57705 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-de38566a-4983-4cc6-ae25-2a20be29f729-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:07 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112" returned: 0 in 0.429s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:07 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info Apr 13 09:46:07 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:08 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:08 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31 Apr 13 09:46:08 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-9160053f-d386-4691-bfa9-19253297c065-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-9160053f-d386-4691-bfa9-19253297c065-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-9160053f-d386-4691-bfa9-19253297c065" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-9160053f-d386-4691-bfa9-19253297c065" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[57609736-c393-4c16-808a-76e348c990c1]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:08 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info" returned: 0 in 0.458s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:08 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info is being set with open permissions: ugo+rw Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:08 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info Apr 13 09:46:08 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:08 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 Apr 13 09:46:08 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:08 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4971532-9d45-41b6-b058-0cca83c9ba31" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d4971532-9d45-41b6-b058-0cca83c9ba31" released by "delete_volume" :: held 0.954s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['9eecc9af-e49d-4f42-a16b-8541e9a20827'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:08 devstack cinder-volume[82295]: WARNING cinder.db.sqlalchemy.api [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1902950925'] Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['123e99fb-18a2-4d0d-ada0-aca15db6e513', '9914314b-dc5b-454f-adf2-87ca81be7bc1', '3337ff29-a42d-495b-aff3-034c1976c046', '0647a774-ae00-428b-8e4c-81a2850fcffb'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:08 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:08 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:08 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.info" returned: 0 in 0.450s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-3fb43321-7dab-4355-b603-380aa6f64615" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-3fb43321-7dab-4355-b603-380aa6f64615" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] snapshot: 69a4f61d-e538-404c-9e6d-23b2ab1e7112, volume: 3fb43321-7dab-4355-b603-380aa6f64615, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25e945e-e88d-4a22-9a00-78c3ab2a54e3]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:08 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065" returned: 0 in 0.513s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:08 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065 Apr 13 09:46:08 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:08 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 Apr 13 09:46:08 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:09 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.405s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0897022b-1300-4b2b-95f1-f488fe26c354 tempest-GroupSnapshotsTest-775201994 None] Delete group completed successfully. Apr 13 09:46:09 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9160053f-d386-4691-bfa9-19253297c065" returned: 0 in 0.393s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-9160053f-d386-4691-bfa9-19253297c065" released by "delete_volume" :: held 0.928s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['1722c795-7415-4a51-a27e-523bbf724a86', '76e3f89a-6d6a-4e34-a6ea-0791ca19c32b', '15ec1764-0c2a-4d39-a745-b2875d5f721a', 'ebf89146-393d-45be-8df0-5776d9521c58'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:09 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112" returned: 0 in 0.467s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[90624201-6efd-47bb-b870-95344a578b9c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-7ae7e914-06af-4081-8565-f1717e7856b8-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:09 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:09 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-7ae7e914-06af-4081-8565-f1717e7856b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:09 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:46:09 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-7ae7e914-06af-4081-8565-f1717e7856b8" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-7ae7e914-06af-4081-8565-f1717e7856b8" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f323bcc3-61c9-4ab3-88e3-47e7cbb94683]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:09 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 Apr 13 09:46:09 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:09 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.488s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleted volume successfully. Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-71632898-0d0b-46c8-a5e3-f07dfbfbc301 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-9160053f-d386-4691-bfa9-19253297c065-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fcc6876d-3d6e-440e-a3d5-97444a30f045 tempest-GroupSnapshotsTest-775201994 None] Group tempest-GroupSnapshotsTest-Group-588818102: creating Apr 13 09:46:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fcc6876d-3d6e-440e-a3d5-97444a30f045 tempest-GroupSnapshotsTest-775201994 None] Group tempest-GroupSnapshotsTest-Group-588818102: created successfully Apr 13 09:46:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fcc6876d-3d6e-440e-a3d5-97444a30f045 tempest-GroupSnapshotsTest-775201994 None] Create group completed successfully. Apr 13 09:46:09 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.635s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:46:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:10 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 Apr 13 09:46:10 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:10 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8" returned: 0 in 0.610s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:10 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8 Apr 13 09:46:10 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:10 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7ae7e914-06af-4081-8565-f1717e7856b8" returned: 0 in 0.692s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-7ae7e914-06af-4081-8565-f1717e7856b8" released by "delete_volume" :: held 1.336s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:10 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['5027d246-dbba-42e9-a49b-6e116ae11073', '44cb9705-f2ad-41f0-b8c5-5771c1acb70e', 'fec68a1c-952f-4cda-9dda-3c70a7afe72d', '50d6ec07-f4b1-4379-80c5-75e6ddf6d9a3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:11 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:11 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-d4af2add-fa66-4f16-a0e6-8178b925193e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-d4af2add-fa66-4f16-a0e6-8178b925193e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-d4af2add-fa66-4f16-a0e6-8178b925193e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-d4af2add-fa66-4f16-a0e6-8178b925193e" acquired by "delete_volume" :: waited 0.047s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1f24df-fe37-4c4b-80af-47a49aa3f8fb]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (d6f96eb1-bf18-4cf1-879b-a04132555820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddb8039-d3fd-4abb-8af1-10e9048f6939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:12 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddb8039-d3fd-4abb-8af1-10e9048f6939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819806377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3101be5b-d549-4463-b859-8db5d76b1bce,host='devstack@QuobyteHD#QuobyteHD',id=01d1c9a0-32dc-4f63-bacb-bf536e43fddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:12Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29986f6f-d9ff-4603-9bdb-3f60aa61d3e2),volume_type_id=29986f6f-d9ff-4603-9bdb-3f60aa61d3e2)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9111159e-7812-4bf2-9f86-ba0ac9f507b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:12 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9111159e-7812-4bf2-9f86-ba0ac9f507b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4769071d-2305-4122-8383-adfbc5c547b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4769071d-2305-4122-8383-adfbc5c547b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d1c9a0-32dc-4f63-bacb-bf536e43fddc', 'volume_name': 'volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:12 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e Apr 13 09:46:12 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfe4dcc-9e9c-44ec-aa15-28caae187c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfe4dcc-9e9c-44ec-aa15-28caae187c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d041aac6-d446-49b2-8c14-ed77a0443b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:12 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Volume 01d1c9a0-32dc-4f63-bacb-bf536e43fddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc', 'volume_size': 1} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615" returned: 0 in 2.287s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 1.250s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:12 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleted volume successfully. Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a099912c-7d71-4fdc-8b24-09eeb215e034]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73ebcd20-23fb-4370-8e83-4218aadce9ad tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-7ae7e914-06af-4081-8565-f1717e7856b8-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:12 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:46:12 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:12 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:12 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e Apr 13 09:46:12 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:12 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.610s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:46:12 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Converted 1024.00 MB image at 447.58 MB/s Apr 13 09:46:12 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 is being set with open permissions: ugo+rw Apr 13 09:46:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:12 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 Apr 13 09:46:12 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:13 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d4af2add-fa66-4f16-a0e6-8178b925193e" returned: 0 in 0.454s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-d4af2add-fa66-4f16-a0e6-8178b925193e" released by "delete_volume" :: held 1.030s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['f897615f-bf67-404f-83e3-0566de10eb80', 'c8348b21-6b5d-4afd-9b7d-a12947ae563a', '677997f3-9db5-4e86-9459-9996a8f39b09', 'fa0483cd-10c8-434e-a52b-1918b6904d19'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:13 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:13 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:13 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615" returned: 0 in 0.468s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-3fb43321-7dab-4355-b603-380aa6f64615" released by "_copy_volume_from_snapshot" :: held 4.524s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-69a4f61d-e538-404c-9e6d-23b2ab1e7112" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-69a4f61d-e538-404c-9e6d-23b2ab1e7112" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Deleting offline snapshot 69a4f61d-e538-404c-9e6d-23b2ab1e7112 of volume 9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] snapshot_file for this snap is: volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0a679c-f27a-402d-af12-74e02058c524]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:13 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 Apr 13 09:46:13 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:13 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:13 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleted volume successfully. Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3b514793-acee-43d7-b52c-80e6fb597d34 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-d4af2add-fa66-4f16-a0e6-8178b925193e-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:13 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112" returned: 0 in 0.490s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70dfddc-8b9b-451d-9f5d-3c3a23a6baed]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:14 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:46:14 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-0b3f0108-0c20-4617-a0eb-0e6915930cec-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-0b3f0108-0c20-4617-a0eb-0e6915930cec-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-0b3f0108-0c20-4617-a0eb-0e6915930cec" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-0b3f0108-0c20-4617-a0eb-0e6915930cec" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bfc6d2-4a7f-4869-84fb-e85b02293823]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:14 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec Apr 13 09:46:14 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:14 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.540s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:14 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 Apr 13 09:46:14 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:14 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:14 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec Apr 13 09:46:14 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:14 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112" returned: 0 in 0.482s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:14 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112 Apr 13 09:46:14 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:15 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0b3f0108-0c20-4617-a0eb-0e6915930cec" returned: 0 in 0.469s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-0b3f0108-0c20-4617-a0eb-0e6915930cec" released by "delete_volume" :: held 1.010s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['9a5c84b3-de85-498b-86e6-7fecb3b4aee8', '43d4a9c2-a463-4b6d-9e66-c104bfddba4b', '48eb7fa7-9177-4f4a-9ddb-80b87b9dd70b', '67d4c84f-c2ec-44ec-b58a-c6ffe578e6a1'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:15 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:15 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:15 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64.69a4f61d-e538-404c-9e6d-23b2ab1e7112" returned: 0 in 0.455s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-69a4f61d-e538-404c-9e6d-23b2ab1e7112" released by "_delete_snapshot" :: held 2.023s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.620s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.012s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Creating offline snapshot 411aa0cc-e2f6-4c85-87d1-d6224b6219eb of volume 4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1433efe7-a05f-475e-ad45-dae17a320489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb43321-7dab-4355-b603-380aa6f64615', 'volume_size': 1, 'source_volid': '9c70c638-6f8d-4589-afa7-9fb7bf186f64', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4cd5bd-baca-4a85-ba90-f12448efdb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25578ff-522e-403e-a7be-bb896185df5d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:15 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Volume volume-3fb43321-7dab-4355-b603-380aa6f64615 (3fb43321-7dab-4355-b603-380aa6f64615): created successfully Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4cd5bd-baca-4a85-ba90-f12448efdb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (12527f9c-9394-41e6-b9a4-9ed231d42b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:15 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bd428b38-b0fe-42d0-a77c-236d88597504 tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:46:15 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 Apr 13 09:46:15 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:15 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.448s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:15 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleted volume successfully. Apr 13 09:46:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-09a42bfa-d3d0-4b9f-aaf0-7f26f72fea12 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-0b3f0108-0c20-4617-a0eb-0e6915930cec-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:16 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb 2G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:16 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb 2G Apr 13 09:46:16 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-02129cb3-20f0-41df-b145-a039c576a483-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-02129cb3-20f0-41df-b145-a039c576a483-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-a64d21ce-8d27-48f9-a775-001d32e75a08" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-a64d21ce-8d27-48f9-a775-001d32e75a08" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-02129cb3-20f0-41df-b145-a039c576a483" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-02129cb3-20f0-41df-b145-a039c576a483" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleting offline snapshot 02129cb3-20f0-41df-b145-a039c576a483 of volume a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] snapshot_file for this snap is: volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9533a2d-bee3-43b5-8cdc-ea9e4ac098a7]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:16 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 Apr 13 09:46:16 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:16 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb 2G" returned: 0 in 0.605s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:16 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb Apr 13 09:46:16 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (4151b97f-f736-442d-a52e-63242292b4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee3d103-ab45-482c-815b-8da03a00162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee3d103-ab45-482c-815b-8da03a00162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181030990',display_name='tempest-VolumesGetTest-Volume-1491956052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1ef016-e892-4fe3-a549-3f8cf4943f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:17Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2359fba4-0b25-42b4-ac1b-e9dce9faa8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2359fba4-0b25-42b4-ac1b-e9dce9faa8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4d5b9a-3e5f-42c2-af27-4df54e71a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4d5b9a-3e5f-42c2-af27-4df54e71a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1ef016-e892-4fe3-a549-3f8cf4943f25', 'volume_name': 'volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b0d0b3-f83a-49c6-9b25-5a6ae2e1dc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b0d0b3-f83a-49c6-9b25-5a6ae2e1dc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbf1541-9dc1-4a24-95a5-fde9e0bfc9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Volume ba1ef016-e892-4fe3-a549-3f8cf4943f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25', 'volume_size': 1} Apr 13 09:46:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:17 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483" returned: 0 in 0.570s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64d21ce-8d27-48f9-a775-001d32e75a08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e4356-322f-49a9-94b0-d1b921415582]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:17 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb" returned: 0 in 0.448s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:17 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb is being set with open permissions: ugo+rw Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:17 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 Apr 13 09:46:17 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:17 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb Apr 13 09:46:17 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:17 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:17 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08" returned: 0 in 0.492s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb" returned: 0 in 0.443s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:17 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 Apr 13 09:46:17 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:17 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info Apr 13 09:46:17 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:17 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483" returned: 0 in 0.450s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:17 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:17 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info is being set with open permissions: ugo+rw Apr 13 09:46:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:17 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483 Apr 13 09:46:17 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:17 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info Apr 13 09:46:17 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:18 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:18 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.info" returned: 0 in 0.421s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.144s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3101be5b-d549-4463-b859-8db5d76b1bce,created_at=2026-04-13T07:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819806377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3101be5b-d549-4463-b859-8db5d76b1bce,host='devstack@QuobyteHD#QuobyteHD',id=01d1c9a0-32dc-4f63-bacb-bf536e43fddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:12Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29986f6f-d9ff-4603-9bdb-3f60aa61d3e2),volume_type_id=29986f6f-d9ff-4603-9bdb-3f60aa61d3e2)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Creating volume 01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:18 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08.02129cb3-20f0-41df-b145-a039c576a483" returned: 0 in 0.470s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:18 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc 1073741824 Apr 13 09:46:18 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8505ef29-e371-4075-bc66-12e464e43684 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Create snapshot completed successfully Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-02129cb3-20f0-41df-b145-a039c576a483" released by "_delete_snapshot" :: held 2.054s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-a64d21ce-8d27-48f9-a775-001d32e75a08" released by "delete_snapshot" :: held 2.069s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['76514294-6516-4b59-8378-7b6409f813b2', 'c28293e4-62ca-4a59-be48-6f495a3fb48c', '5e4ead4b-143e-40eb-89d1-518c8e77a4eb', '5ec1b6aa-e650-4823-a7ca-519a5b0b0a13'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Delete snapshot completed successfully. Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-741ceb27-feba-4abb-ac92-fc4ac2744725 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-02129cb3-20f0-41df-b145-a039c576a483-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-a64d21ce-8d27-48f9-a775-001d32e75a08-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-a64d21ce-8d27-48f9-a775-001d32e75a08-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "cinder-quobyte-a64d21ce-8d27-48f9-a775-001d32e75a08" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-a64d21ce-8d27-48f9-a775-001d32e75a08" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[97efc326-4d70-4995-9adf-67df4a3d3d73]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:18 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 Apr 13 09:46:18 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:18 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc 1073741824" returned: 0 in 0.561s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:19 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc Apr 13 09:46:19 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:19 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08" returned: 0 in 0.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:19 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08 Apr 13 09:46:19 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "cinder-411aa0cc-e2f6-4c85-87d1-d6224b6219eb-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-411aa0cc-e2f6-4c85-87d1-d6224b6219eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "cinder-quobyte-4679ce01-31c0-4ba0-86e2-7d21d2c18902" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-quobyte-4679ce01-31c0-4ba0-86e2-7d21d2c18902" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "cinder-quobyte-411aa0cc-e2f6-4c85-87d1-d6224b6219eb" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-quobyte-411aa0cc-e2f6-4c85-87d1-d6224b6219eb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Deleting offline snapshot 411aa0cc-e2f6-4c85-87d1-d6224b6219eb of volume 4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] snapshot_file for this snap is: volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ad8983-9b2e-4206-b08f-74bf753ede4a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:19 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" returned: 0 in 0.505s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.769s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1181030990',display_name='tempest-VolumesGetTest-Volume-1491956052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1ef016-e892-4fe3-a549-3f8cf4943f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:17Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Creating volume ba1ef016-e892-4fe3-a549-3f8cf4943f25 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:19 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:19 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb Apr 13 09:46:19 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:19 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 1073741824 Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d041aac6-d446-49b2-8c14-ed77a0443b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:19 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d107c26c-274d-4cb9-9b61-9d20802948ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:19 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Volume volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc (01d1c9a0-32dc-4f63-bacb-bf536e43fddc): created successfully Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d107c26c-274d-4cb9-9b61-9d20802948ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (d6f96eb1-bf18-4cf1-879b-a04132555820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:19 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9955818f-f53d-42f1-90c2-8f9306e1d1c9 tempest-GroupSnapshotsTest-775201994 None] Created volume successfully. Apr 13 09:46:19 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a64d21ce-8d27-48f9-a775-001d32e75a08" returned: 0 in 0.490s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-quobyte-a64d21ce-8d27-48f9-a775-001d32e75a08" released by "delete_volume" :: held 1.045s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Created reservations ['348868ae-db19-4bc2-8348-a4aa70a07152', '1e5498ad-0c1c-4efc-be65-dc95d7c60279', '2c6b3b2f-7237-4f65-9129-73e9566566a3', '39566e58-fc4f-4963-86db-9d99b6e63613'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:19 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:19 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (73a00c0e-0c21-4f29-ad36-00fb97f6dddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25be3389-76f8-427d-97cd-e8cc8f9c4760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25be3389-76f8-427d-97cd-e8cc8f9c4760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957714847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3101be5b-d549-4463-b859-8db5d76b1bce,host='devstack@QuobyteHD#QuobyteHD',id=59fc015d-f46a-4533-a9ca-82f200c6951b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:20Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29986f6f-d9ff-4603-9bdb-3f60aa61d3e2),volume_type_id=29986f6f-d9ff-4603-9bdb-3f60aa61d3e2)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b6c42e-c6fe-4dbe-941e-4d894c69735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b6c42e-c6fe-4dbe-941e-4d894c69735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f24df0c-1dcd-4954-8487-b0ff9ab7ee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f24df0c-1dcd-4954-8487-b0ff9ab7ee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fc015d-f46a-4533-a9ca-82f200c6951b', 'volume_name': 'volume-59fc015d-f46a-4533-a9ca-82f200c6951b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a4737d-97ba-4093-82f4-fb5f895f6b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a4737d-97ba-4093-82f4-fb5f895f6b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:20 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f050cd-119f-4ffd-a432-e382e8967ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:20 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Volume 59fc015d-f46a-4533-a9ca-82f200c6951b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fc015d-f46a-4533-a9ca-82f200c6951b', 'volume_size': 1} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb" returned: 0 in 0.672s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e13c44-f32c-4a94-912a-a9460251a2bb]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:20 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 1073741824" returned: 0 in 0.654s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:20 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 Apr 13 09:46:20 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:20 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 Apr 13 09:46:20 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:20 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.543s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:20 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Deleted volume successfully. Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-5aa8b0c4-199f-4006-839e-356318c8ba25 tempest-CreateVolumesFromSnapshotTest-635659478 None] Lock "cinder-a64d21ce-8d27-48f9-a775-001d32e75a08-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:20 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3101be5b-d549-4463-b859-8db5d76b1bce,created_at=2026-04-13T07:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957714847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3101be5b-d549-4463-b859-8db5d76b1bce,host='devstack@QuobyteHD#QuobyteHD',id=59fc015d-f46a-4533-a9ca-82f200c6951b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:20Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29986f6f-d9ff-4603-9bdb-3f60aa61d3e2),volume_type_id=29986f6f-d9ff-4603-9bdb-3f60aa61d3e2)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Creating volume 59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:20 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:20 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:20 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b 1073741824 Apr 13 09:46:20 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbf1541-9dc1-4a24-95a5-fde9e0bfc9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326105a3-607f-40c4-a24f-b20c37c22aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902" returned: 0 in 0.536s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:20 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Volume volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 (ba1ef016-e892-4fe3-a549-3f8cf4943f25): created successfully Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326105a3-607f-40c4-a24f-b20c37c22aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:20 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb Apr 13 09:46:20 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (4151b97f-f736-442d-a52e-63242292b4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:20 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-56fbfcc1-678c-4ddc-b274-87593cd6d82c tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-ba1ef016-e892-4fe3-a549-3f8cf4943f25-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Lock "cinder-ba1ef016-e892-4fe3-a549-3f8cf4943f25-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-ba1ef016-e892-4fe3-a549-3f8cf4943f25" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-ba1ef016-e892-4fe3-a549-3f8cf4943f25" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a4c1f9-e15a-447f-bd25-51c778d5045b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:21 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 Apr 13 09:46:21 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:21 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b 1073741824" returned: 0 in 0.601s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:21 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb" returned: 0 in 0.574s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:21 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb Apr 13 09:46:21 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:21 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b Apr 13 09:46:21 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:21 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25" returned: 0 in 0.579s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:21 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25 Apr 13 09:46:21 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:21 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902.411aa0cc-e2f6-4c85-87d1-d6224b6219eb" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:21 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b" returned: 0 in 0.544s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-quobyte-411aa0cc-e2f6-4c85-87d1-d6224b6219eb" released by "_delete_snapshot" :: held 2.424s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-quobyte-4679ce01-31c0-4ba0-86e2-7d21d2c18902" released by "delete_snapshot" :: held 2.442s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f050cd-119f-4ffd-a432-e382e8967ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fc015d-f46a-4533-a9ca-82f200c6951b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4fe77e-77bb-4980-ab43-5dc8e55af92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:21 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Volume volume-59fc015d-f46a-4533-a9ca-82f200c6951b (59fc015d-f46a-4533-a9ca-82f200c6951b): created successfully Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4fe77e-77bb-4980-ab43-5dc8e55af92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (73a00c0e-0c21-4f29-ad36-00fb97f6dddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-68ff4d8a-8da3-46cb-9f25-dbfe75425fca tempest-GroupSnapshotsTest-775201994 None] Created volume successfully. Apr 13 09:46:21 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Created reservations ['abeecc0b-f08f-40d8-a477-9ed90c45a4af', '66796218-8b82-4871-b734-8db8ee90296e', '8561e76d-c6bf-4751-953b-a9f08d9d1597', '97631d78-67cc-4884-950f-4e54c82a1615'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Delete snapshot completed successfully. Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f5651abc-3f9a-42c9-8731-ce814a48c1d3 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-411aa0cc-e2f6-4c85-87d1-d6224b6219eb-delete_snapshot" released by "delete_snapshot" :: held 2.633s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:22 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-048623af-8e16-402b-87ae-3ec1a94e0c99 tempest-GroupSnapshotsTest-775201994 None] Update group completed successfully. Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ba1ef016-e892-4fe3-a549-3f8cf4943f25" returned: 0 in 0.602s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-ba1ef016-e892-4fe3-a549-3f8cf4943f25" released by "delete_volume" :: held 1.206s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Created reservations ['bbebf2aa-efce-4e40-a976-b53953db8e9e', 'a3c9785a-fe29-4e92-a42f-057b44ca7d90', 'cc8748b6-52c4-40a9-a591-4b8cd84888f5', '6e51586c-59ba-4ed8-84be-df45d8c8645b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:22 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:22 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "cinder-4679ce01-31c0-4ba0-86e2-7d21d2c18902-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-4679ce01-31c0-4ba0-86e2-7d21d2c18902-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "cinder-quobyte-4679ce01-31c0-4ba0-86e2-7d21d2c18902" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-quobyte-4679ce01-31c0-4ba0-86e2-7d21d2c18902" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc847a7-a02b-4e66-98ee-ebf2c5739c8f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:22 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 Apr 13 09:46:22 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (6c303b7b-a719-4b89-998f-a177956ea750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c09bc-944e-4cf4-b6d7-6c88c72f7c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c09bc-944e-4cf4-b6d7-6c88c72f7c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844162428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826c8d53-160d-48c6-8b71-8446ca530650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:23Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d4b280-e1bf-4cd0-909b-668cb39a813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d4b280-e1bf-4cd0-909b-668cb39a813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f709ce52-1b15-4ee3-9d3d-c1744184f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f709ce52-1b15-4ee3-9d3d-c1744184f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826c8d53-160d-48c6-8b71-8446ca530650', 'volume_name': 'volume-826c8d53-160d-48c6-8b71-8446ca530650', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87cf535-97b2-4928-9fc5-261216082ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87cf535-97b2-4928-9fc5-261216082ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eda10fe-5d7f-4620-9bcf-6602d6875a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:22 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume 826c8d53-160d-48c6-8b71-8446ca530650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826c8d53-160d-48c6-8b71-8446ca530650', 'volume_size': 1} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844162428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826c8d53-160d-48c6-8b71-8446ca530650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:23Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Creating volume 826c8d53-160d-48c6-8b71-8446ca530650 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:22 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:23 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 1073741824 Apr 13 09:46:23 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:23 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.532s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:23 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cbfe384e-7135-48ee-a224-9d57a185212d tempest-VolumesGetTest-194080950 None] Lock "cinder-ba1ef016-e892-4fe3-a549-3f8cf4943f25-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:23 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902" returned: 0 in 0.549s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:23 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902 Apr 13 09:46:23 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-3fb43321-7dab-4355-b603-380aa6f64615-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Lock "cinder-3fb43321-7dab-4355-b603-380aa6f64615-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-3fb43321-7dab-4355-b603-380aa6f64615" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-3fb43321-7dab-4355-b603-380aa6f64615" acquired by "delete_volume" :: waited 0.026s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5915a76-a655-4280-b1b2-dea57cdc4c14]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:23 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4888d27a-3a34-4b29-b332-d9eec121b73d tempest-GroupSnapshotsTest-775201994 None] Update group completed successfully. Apr 13 09:46:23 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 Apr 13 09:46:23 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:23 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 1073741824" returned: 0 in 0.592s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:23 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 Apr 13 09:46:23 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:23 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4679ce01-31c0-4ba0-86e2-7d21d2c18902" returned: 0 in 0.502s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-quobyte-4679ce01-31c0-4ba0-86e2-7d21d2c18902" released by "delete_volume" :: held 1.081s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Created reservations ['5776a24d-6bed-411b-8863-e3afd1255c5c', '2be8d9c7-214b-4b36-b265-69994ddefa0a', '7ac14ac0-04bc-4346-b1ee-5b931645bdff', 'd48a88d5-1f9d-4326-a298-44cfd8eca6d9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:23 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:23 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:24 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615" returned: 0 in 0.603s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:24 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615 Apr 13 09:46:24 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:24 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eda10fe-5d7f-4620-9bcf-6602d6875a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826c8d53-160d-48c6-8b71-8446ca530650', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14f3784-364a-4c88-8b69-25824924e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:24 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume volume-826c8d53-160d-48c6-8b71-8446ca530650 (826c8d53-160d-48c6-8b71-8446ca530650): created successfully Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14f3784-364a-4c88-8b69-25824924e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (6c303b7b-a719-4b89-998f-a177956ea750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:24 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ef4ff396-13b4-4048-b5a9-56bf2b877d35 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created volume successfully. Apr 13 09:46:24 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:24 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Deleted volume successfully. Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-857e5a68-c079-41b3-9de2-5e6433f08d12 tempest-VolumesSnapshotNegativeTestJSON-880413759 None] Lock "cinder-4679ce01-31c0-4ba0-86e2-7d21d2c18902-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:24 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-3fb43321-7dab-4355-b603-380aa6f64615" returned: 0 in 0.495s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-3fb43321-7dab-4355-b603-380aa6f64615" released by "delete_volume" :: held 1.130s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:24 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-961c31f5-3ad6-43b4-b775-fa5ce7f2f1dd tempest-GroupSnapshotsTest-775201994 None] Update group completed successfully. Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Created reservations ['676ef998-30b5-499c-a62c-9b0fa8e19269', 'a87a3b98-460f-436c-8ec7-fef2b011bb68', 'a5a6e633-2b9e-4177-8e83-ca84a516cc7d', '9178905f-793e-4be6-9d92-613dcad7fe33'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:24 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:24 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:25 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.550s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fc3d4a11-9581-4d4d-83fd-d2a5fcce5184 tempest-VolumesGetTest-194080950 None] Lock "cinder-3fb43321-7dab-4355-b603-380aa6f64615-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (1b32e0f2-7155-4961-984d-de9d717abc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b3529d-201b-4af5-8dfa-41128185f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b3529d-201b-4af5-8dfa-41128185f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208471462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625cc326-d037-4dbd-976f-cdff252a8c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:25Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38635db-7e02-4c0a-951c-14b6c409df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38635db-7e02-4c0a-951c-14b6c409df80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6c3cb7-61bc-421e-8a33-c1d9de9e6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6c3cb7-61bc-421e-8a33-c1d9de9e6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625cc326-d037-4dbd-976f-cdff252a8c96', 'volume_name': 'volume-625cc326-d037-4dbd-976f-cdff252a8c96', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba84d15-f862-4e18-bc53-0bbb1a7a17d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba84d15-f862-4e18-bc53-0bbb1a7a17d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d382d7d-7a14-4464-b51a-f2870a5bdc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume 625cc326-d037-4dbd-976f-cdff252a8c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625cc326-d037-4dbd-976f-cdff252a8c96', 'volume_size': 1} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208471462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625cc326-d037-4dbd-976f-cdff252a8c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:25Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Creating volume 625cc326-d037-4dbd-976f-cdff252a8c96 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:25 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:25 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 1073741824 Apr 13 09:46:25 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-9c70c638-6f8d-4589-afa7-9fb7bf186f64-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Lock "cinder-9c70c638-6f8d-4589-afa7-9fb7bf186f64-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-9c70c638-6f8d-4589-afa7-9fb7bf186f64" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-9c70c638-6f8d-4589-afa7-9fb7bf186f64" acquired by "delete_volume" :: waited 0.026s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (4cbd945a-7b8a-4bc7-ac73-4c94ca266cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52a27d1-84ac-4407-ba05-45f276300080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[de176cb9-b5a4-42ad-bfc8-22ae795e730a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52a27d1-84ac-4407-ba05-45f276300080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148803286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36731b07-2a06-43fa-a9b6-9cc29c981d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:26Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c126e1f-45f6-4280-87af-2418480e36a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c126e1f-45f6-4280-87af-2418480e36a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850ce21a-6dc0-4731-98fb-355c608a9740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850ce21a-6dc0-4731-98fb-355c608a9740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36731b07-2a06-43fa-a9b6-9cc29c981d49', 'volume_name': 'volume-36731b07-2a06-43fa-a9b6-9cc29c981d49', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa9e8f3-f23c-4302-8477-212a9f2e28fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa9e8f3-f23c-4302-8477-212a9f2e28fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff251e89-2ffd-45cf-99bc-15f2a0553468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume 36731b07-2a06-43fa-a9b6-9cc29c981d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36731b07-2a06-43fa-a9b6-9cc29c981d49', 'volume_size': 1} Apr 13 09:46:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:26 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:46:26 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (3190b53c-5e75-4639-a79f-fc99f5f45ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa008a9-e125-4efb-9067-778b960c42ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa008a9-e125-4efb-9067-778b960c42ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723864110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b12bdf-8b3d-4618-95a2-985af1b9c54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:26Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1d6c36-646a-4df1-80de-4167266a026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1d6c36-646a-4df1-80de-4167266a026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36543f10-86d2-4bd8-a3e7-c9e10c2de2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36543f10-86d2-4bd8-a3e7-c9e10c2de2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b12bdf-8b3d-4618-95a2-985af1b9c54b', 'volume_name': 'volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fbeedf-7ab3-43f0-9c27-0f62813ba0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fbeedf-7ab3-43f0-9c27-0f62813ba0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223e8b15-7708-4eeb-b256-645448c51e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume d0b12bdf-8b3d-4618-95a2-985af1b9c54b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b', 'volume_size': 1} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-36109ccf-86e9-47e7-a65c-970fd1c95816 tempest-GroupSnapshotsTest-775201994 None] Update group completed successfully. Apr 13 09:46:26 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (1bfefb3b-d04c-471c-b391-46e8ff805edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3717b6-0205-4ccc-9b62-82c46e2871b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 1073741824" returned: 0 in 0.856s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c3717b6-0205-4ccc-9b62-82c46e2871b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785147283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068b2bc6-81a7-488c-b262-cfdfed84ee3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:26Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd884ad-4fad-4a83-8113-714045c6d463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd884ad-4fad-4a83-8113-714045c6d463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092bd905-d708-49a9-8345-19d68018a162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092bd905-d708-49a9-8345-19d68018a162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068b2bc6-81a7-488c-b262-cfdfed84ee3b', 'volume_name': 'volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111f30db-68cc-4c2b-b3c2-4a218c79300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111f30db-68cc-4c2b-b3c2-4a218c79300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d53dc9a-31b2-4a66-b6eb-7abb1e26e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume 068b2bc6-81a7-488c-b262-cfdfed84ee3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b', 'volume_size': 1} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:26 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 Apr 13 09:46:26 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (bcaaa324-cbf8-4386-b6d3-639a6ef675c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270ce5d6-29b4-4f32-9624-c751ff91b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270ce5d6-29b4-4f32-9624-c751ff91b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1285206371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c45323d-3c22-47d5-aca2-cb1244a66c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:27Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8ce30c-55d3-45ca-86b1-465ae0726220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8ce30c-55d3-45ca-86b1-465ae0726220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebd4ad9-189b-4c64-adea-5154cc3a2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebd4ad9-189b-4c64-adea-5154cc3a2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c45323d-3c22-47d5-aca2-cb1244a66c3e', 'volume_name': 'volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c547705-141e-4b67-876c-d686006d433f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c547705-141e-4b67-876c-d686006d433f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837b4635-8860-4168-9efc-7e09acc35a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume 0c45323d-3c22-47d5-aca2-cb1244a66c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e', 'volume_size': 1} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:26 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.886s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:26 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64 Apr 13 09:46:26 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:26 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96" returned: 0 in 0.566s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.980s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148803286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36731b07-2a06-43fa-a9b6-9cc29c981d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:26Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Creating volume 36731b07-2a06-43fa-a9b6-9cc29c981d49 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d382d7d-7a14-4464-b51a-f2870a5bdc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625cc326-d037-4dbd-976f-cdff252a8c96', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ee855f-9c3d-489b-a701-8496ac5b2b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:26 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 1073741824 Apr 13 09:46:26 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume volume-625cc326-d037-4dbd-976f-cdff252a8c96 (625cc326-d037-4dbd-976f-cdff252a8c96): created successfully Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ee855f-9c3d-489b-a701-8496ac5b2b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (1b32e0f2-7155-4961-984d-de9d717abc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:26 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cd1c16a3-babd-4333-8a87-7fe5a4bcf494 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created volume successfully. Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Flow 'volume_create_manager' (814053b7-cb83-4eea-a3f3-6d32158709ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71d7759-d75c-4cc0-8d81-11dc23d97c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71d7759-d75c-4cc0-8d81-11dc23d97c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692eef38-e88e-445a-af6e-b026e19d148b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d31af11e7d45989d2148867e14f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:27Z,use_quota=True,user_id='46a40f8628a64f9f9c879d71d1456097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c41a52-f183-4fd9-adc2-6afd9a5a194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c41a52-f183-4fd9-adc2-6afd9a5a194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dc33df-c558-445e-a05f-4da8e0be46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dc33df-c558-445e-a05f-4da8e0be46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692eef38-e88e-445a-af6e-b026e19d148b', 'volume_name': 'volume-692eef38-e88e-445a-af6e-b026e19d148b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e8a814-4063-4771-b385-5fedb05d6fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e8a814-4063-4771-b385-5fedb05d6fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9fea49-5a57-4cea-b1cb-b779dbfc2bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Volume 692eef38-e88e-445a-af6e-b026e19d148b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692eef38-e88e-445a-af6e-b026e19d148b', 'volume_size': 1} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:27 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-9c70c638-6f8d-4589-afa7-9fb7bf186f64" returned: 0 in 0.548s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-9c70c638-6f8d-4589-afa7-9fb7bf186f64" released by "delete_volume" :: held 1.531s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Created reservations ['713616c0-0195-47e6-9374-47d57b874a04', 'e7e227d8-719f-48ff-ae54-475854036743', '0592a47a-a4af-485c-b2a2-469949a853f8', 'bd46ce5c-03a6-46e1-bfb5-9cc48f7f8b2f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] GroupSnapshot a04e8278-ecd8-405d-b7e3-0c0c47a03c49: creating. Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Group snapshot a04e8278-ecd8-405d-b7e3-0c0c47a03c49: creating. {{(pid=82295) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:27 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:27 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:27 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 1073741824" returned: 0 in 0.623s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:27 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 Apr 13 09:46:27 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:27 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.443s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:46:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ac871b9-a9d8-47ac-a03d-180018acb7cf tempest-VolumesGetTest-194080950 None] Lock "cinder-9c70c638-6f8d-4589-afa7-9fb7bf186f64-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:28 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49" returned: 0 in 0.469s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723864110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b12bdf-8b3d-4618-95a2-985af1b9c54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:26Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Creating volume d0b12bdf-8b3d-4618-95a2-985af1b9c54b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:28 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff251e89-2ffd-45cf-99bc-15f2a0553468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36731b07-2a06-43fa-a9b6-9cc29c981d49', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35d115f-60b5-4ab2-91a4-2fe499e7ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:28 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b 1073741824 Apr 13 09:46:28 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:28 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 (36731b07-2a06-43fa-a9b6-9cc29c981d49): created successfully Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35d115f-60b5-4ab2-91a4-2fe499e7ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (4cbd945a-7b8a-4bc7-ac73-4c94ca266cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-05f38aa5-ecf6-438c-81b7-8d97e21552b7 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created volume successfully. Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (749fec8d-7670-43e5-9836-cf6cfaeb255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f3aa5-0f42-454f-be1b-f504c4222fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f3aa5-0f42-454f-be1b-f504c4222fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1078083603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a628f561-7a32-405b-ab8d-4c5a27f9b6b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:28Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca1c89d-c131-4532-b57c-877b23aa4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca1c89d-c131-4532-b57c-877b23aa4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6a0d28-b20b-4e0a-b62a-d06534393dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.image.glance [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Creating Keystone auth plugin from conf {{(pid=82295) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6a0d28-b20b-4e0a-b62a-d06534393dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a628f561-7a32-405b-ab8d-4c5a27f9b6b6', 'volume_name': 'volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c57a32-b525-4d77-b824-488d89a32a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c57a32-b525-4d77-b824-488d89a32a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb0dcef-da23-40f9-9e7f-e18d7d2a642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:28 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Volume a628f561-7a32-405b-ab8d-4c5a27f9b6b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Trying to clone a628f561-7a32-405b-ab8d-4c5a27f9b6b6 from image 168ef6f7-3a65-468d-bd46-416aedea31b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]). {{(pid=82295) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 09:46:28 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b 1073741824" returned: 0 in 0.596s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:28 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b Apr 13 09:46:28 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 09:46:28 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Image download 20.69 MB at 20.69 MB/s Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce8fef-afee-4193-9003-a82777ff0c42]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:28 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD Apr 13 09:46:28 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:29 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.825s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785147283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068b2bc6-81a7-488c-b262-cfdfed84ee3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:26Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Creating volume 068b2bc6-81a7-488c-b262-cfdfed84ee3b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:29 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223e8b15-7708-4eeb-b256-645448c51e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8fc118-ee09-4f58-8dcf-e4331b65a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:29 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b 1073741824 Apr 13 09:46:29 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b (d0b12bdf-8b3d-4618-95a2-985af1b9c54b): created successfully Apr 13 09:46:29 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8fc118-ee09-4f58-8dcf-e4331b65a3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (3190b53c-5e75-4639-a79f-fc99f5f45ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-53c36489-11ad-4f93-b83c-6046d4d3f03e tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created volume successfully. Apr 13 09:46:29 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 is fetched for user 1ffdb2d92b1244679a73233bf43df721. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc533f-d248-49fc-8cf3-761e96e93581]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:29 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD Apr 13 09:46:29 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:29 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b 1073741824" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:29 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b Apr 13 09:46:29 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:29 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:30 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b" returned: 0 in 0.456s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.558s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1285206371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c45323d-3c22-47d5-aca2-cb1244a66c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f3a2b5e67e946b896ce7d25e62df972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:27Z,use_quota=True,user_id='54acbba63f6e411187bc982e4ef70362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Creating volume 0c45323d-3c22-47d5-aca2-cb1244a66c3e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:30 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d53dc9a-31b2-4a66-b6eb-7abb1e26e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:30 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e 1073741824 Apr 13 09:46:30 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c7d06b-98f7-4057-a69f-f6e813d2e165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:30 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b (068b2bc6-81a7-488c-b262-cfdfed84ee3b): created successfully Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c7d06b-98f7-4057-a69f-f6e813d2e165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (1bfefb3b-d04c-471c-b391-46e8ff805edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c4d6b5fa-cd06-4410-8b32-cc074b7455ac tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created volume successfully. Apr 13 09:46:30 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e 1073741824" returned: 0 in 0.474s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:30 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e Apr 13 09:46:30 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:31 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e" returned: 0 in 0.407s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.917s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692eef38-e88e-445a-af6e-b026e19d148b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d31af11e7d45989d2148867e14f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:27Z,use_quota=True,user_id='46a40f8628a64f9f9c879d71d1456097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Creating volume 692eef38-e88e-445a-af6e-b026e19d148b {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:31 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837b4635-8860-4168-9efc-7e09acc35a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f11a26-c406-4902-b26c-2729eaf5b1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:31 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b 1073741824 Apr 13 09:46:31 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:31 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Volume volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e (0c45323d-3c22-47d5-aca2-cb1244a66c3e): created successfully Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f11a26-c406-4902-b26c-2729eaf5b1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Flow 'volume_create_manager' (bcaaa324-cbf8-4386-b6d3-639a6ef675c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-01bf1afa-abd7-493e-b45b-0490e36114c4 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created volume successfully. Apr 13 09:46:31 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b 1073741824" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:31 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b Apr 13 09:46:31 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:32 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b" returned: 0 in 0.399s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.698s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9fea49-5a57-4cea-b1cb-b779dbfc2bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692eef38-e88e-445a-af6e-b026e19d148b', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c090e73b-3324-4921-af3c-07e6f4bc03c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Creating offline snapshot 3242bf53-d469-4801-b00f-3546c3bc146f of volume 01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:32 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Volume volume-692eef38-e88e-445a-af6e-b026e19d148b (692eef38-e88e-445a-af6e-b026e19d148b): created successfully Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c090e73b-3324-4921-af3c-07e6f4bc03c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Flow 'volume_create_manager' (814053b7-cb83-4eea-a3f3-6d32158709ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[38011357-ff2f-42b0-87f2-e2ea4aa810b2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-0c45323d-3c22-47d5-aca2-cb1244a66c3e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:32 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b10a831f-437e-4baa-b547-db07ec5fa33f tempest-CinderUnicodeTest-576878773 None] Created volume successfully. Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-0c45323d-3c22-47d5-aca2-cb1244a66c3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-quobyte-0c45323d-3c22-47d5-aca2-cb1244a66c3e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-0c45323d-3c22-47d5-aca2-cb1244a66c3e" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:32 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc Apr 13 09:46:32 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adbdf00-21db-4306-9722-a6b2388195ea]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:32 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e Apr 13 09:46:32 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:32 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:32 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" returned: 0 in 0.613s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e" returned: 0 in 0.539s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:32 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f 1G Apr 13 09:46:32 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:32 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e Apr 13 09:46:32 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Flow 'volume_create_manager' (fe86b0b8-aee8-47d9-a343-547684eba664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e71b89-4a35-48eb-bade-dbd53d956fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e71b89-4a35-48eb-bade-dbd53d956fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-562085561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384510f0-3ec6-4f7b-ba2e-d918b11d61d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d31af11e7d45989d2148867e14f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:33Z,use_quota=True,user_id='46a40f8628a64f9f9c879d71d1456097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2608e3a-f6f8-4714-99f7-092adf02b8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2608e3a-f6f8-4714-99f7-092adf02b8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd247245-3fd1-48f8-bfa3-2bfc8ca123d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd247245-3fd1-48f8-bfa3-2bfc8ca123d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384510f0-3ec6-4f7b-ba2e-d918b11d61d6', 'volume_name': 'volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1b837a-b572-4719-b00c-52060bbb9e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1b837a-b572-4719-b00c-52060bbb9e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771937bb-b354-45a6-9893-ea8630540618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:32 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Volume 384510f0-3ec6-4f7b-ba2e-d918b11d61d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6', 'volume_size': 1} Apr 13 09:46:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:33 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c45323d-3c22-47d5-aca2-cb1244a66c3e" returned: 0 in 0.412s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-0c45323d-3c22-47d5-aca2-cb1244a66c3e" released by "delete_volume" :: held 0.980s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created reservations ['b9ff1166-5379-4f37-a7c3-76b7b2e17940', 'f37e8445-55c7-458d-a653-1c7aba2278a7', '8693bc08-0a9a-493c-948c-2c437c1078fc', '1306ea9d-1c57-4751-99d8-96be9c9989c9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:33 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f 1G" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:33 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f Apr 13 09:46:33 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:33 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:33 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:33 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.414s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:33 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Deleted volume successfully. Apr 13 09:46:33 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-be0bdbc7-e6dd-4939-8883-032a8d4e75b8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-0c45323d-3c22-47d5-aca2-cb1244a66c3e-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:33 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:33 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f Apr 13 09:46:33 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:34 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f" returned: 0 in 0.401s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:34 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info Apr 13 09:46:34 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-068b2bc6-81a7-488c-b262-cfdfed84ee3b-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-068b2bc6-81a7-488c-b262-cfdfed84ee3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-quobyte-068b2bc6-81a7-488c-b262-cfdfed84ee3b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-068b2bc6-81a7-488c-b262-cfdfed84ee3b" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[76168575-a664-428e-92b2-232c0fce4b5e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:34 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b Apr 13 09:46:34 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:34 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:34 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:34 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info Apr 13 09:46:34 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:34 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b" returned: 0 in 0.499s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:34 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b Apr 13 09:46:34 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:34 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.info" returned: 0 in 0.466s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=254,cinder:INSERT=76,cinder:UPDATE=331,cinder:DELETE=23 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:46:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Creating offline snapshot c494c434-5d24-4aa6-96e7-e2471f010593 of volume 59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c1ffac-7263-480a-9fd8-b82d37dbd908]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:35 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b Apr 13 09:46:35 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:35 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-068b2bc6-81a7-488c-b262-cfdfed84ee3b" returned: 0 in 0.402s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-068b2bc6-81a7-488c-b262-cfdfed84ee3b" released by "delete_volume" :: held 0.924s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:UPDATE=294,cinder:DELETE=25,cinder:SELECT=243,cinder:INSERT=74 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created reservations ['bf3c17ac-6fc4-484e-8c92-582637473555', '95bda023-f7bf-43c0-810b-389c521ad2c3', '5a90a2e8-67bd-4c97-9a5b-fea87efbb448', 'a905b507-e77d-4df6-8a71-df17f9747fb2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:35 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:35 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-d0b12bdf-8b3d-4618-95a2-985af1b9c54b-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-d0b12bdf-8b3d-4618-95a2-985af1b9c54b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-quobyte-d0b12bdf-8b3d-4618-95a2-985af1b9c54b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-d0b12bdf-8b3d-4618-95a2-985af1b9c54b" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9b1e31-c77d-4af4-b4f5-1538774977d1]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:35 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b Apr 13 09:46:35 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:35 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:35 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 1G Apr 13 09:46:35 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:35 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.429s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:35 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Deleted volume successfully. Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-623d9777-06ea-45d0-b02d-35c67b6307e5 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-068b2bc6-81a7-488c-b262-cfdfed84ee3b-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:35 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b" returned: 0 in 0.511s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:35 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b Apr 13 09:46:35 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:36 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 1G" returned: 0 in 0.550s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fc015d-f46a-4533-a9ca-82f200c6951b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:36 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fc015d-f46a-4533-a9ca-82f200c6951b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 Apr 13 09:46:36 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:36 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d0b12bdf-8b3d-4618-95a2-985af1b9c54b" returned: 0 in 0.432s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-d0b12bdf-8b3d-4618-95a2-985af1b9c54b" released by "delete_volume" :: held 0.971s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created reservations ['26214f50-70dd-417e-b4c0-e5e8008afd23', '821da79a-6248-47f8-94f3-2d7da4c85346', 'ce9ffae8-85be-4a11-9696-40bd165cc1e7', '869ec9f3-b417-44a2-974e-4d8489baa9ec'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:36 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:36 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-36731b07-2a06-43fa-a9b6-9cc29c981d49-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-36731b07-2a06-43fa-a9b6-9cc29c981d49-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:36 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-quobyte-36731b07-2a06-43fa-a9b6-9cc29c981d49" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fc015d-f46a-4533-a9ca-82f200c6951b -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593" returned: 0 in 0.472s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:36 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-36731b07-2a06-43fa-a9b6-9cc29c981d49" acquired by "delete_volume" :: waited 0.023s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:36 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 Apr 13 09:46:36 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed99e4d3-f446-4df8-a83b-36d547629255]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:36 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 Apr 13 09:46:36 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:36 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.470s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Deleted volume successfully. Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-68e9f38a-a03e-4b95-9265-ae55d2c43d39 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-d0b12bdf-8b3d-4618-95a2-985af1b9c54b-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:36 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593" returned: 0 in 0.434s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:37 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info Apr 13 09:46:37 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:37 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:37 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49 Apr 13 09:46:37 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:37 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info" returned: 0 in 0.411s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:37 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:37 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info Apr 13 09:46:37 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:37 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-36731b07-2a06-43fa-a9b6-9cc29c981d49" returned: 0 in 0.395s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-36731b07-2a06-43fa-a9b6-9cc29c981d49" released by "delete_volume" :: held 0.922s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created reservations ['85b099b9-f5ba-4f58-9173-afc75a993684', '90b854c4-367e-4ecd-ac2c-ef8d73ec8950', '76067a2d-e67b-46ba-9809-6c5938b2b771', '096928d1-7c75-4a25-bca6-5b665edce082'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:37 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:37 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-625cc326-d037-4dbd-976f-cdff252a8c96-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-625cc326-d037-4dbd-976f-cdff252a8c96-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-quobyte-625cc326-d037-4dbd-976f-cdff252a8c96" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-625cc326-d037-4dbd-976f-cdff252a8c96" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5690cee5-dcfb-41d1-b0d2-b6fa83b2fdf8]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:37 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 Apr 13 09:46:37 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:37 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.info" returned: 0 in 0.449s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.099s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-562085561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384510f0-3ec6-4f7b-ba2e-d918b11d61d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d31af11e7d45989d2148867e14f807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:33Z,use_quota=True,user_id='46a40f8628a64f9f9c879d71d1456097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Creating volume 384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:37 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:37 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 1073741824 Apr 13 09:46:37 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:37 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c4fcaabb-35d0-49a1-885a-4e6d7600f061 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a04e8278-ecd8-405d-b7e3-0c0c47a03c49: created successfully Apr 13 09:46:38 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Deleted volume successfully. Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b0c397cc-6e8f-4acd-a798-2640625b8732 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-36731b07-2a06-43fa-a9b6-9cc29c981d49-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:38 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96" returned: 0 in 0.511s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:38 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96 Apr 13 09:46:38 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:38 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 1073741824" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:38 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 Apr 13 09:46:38 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:38 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-625cc326-d037-4dbd-976f-cdff252a8c96" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-625cc326-d037-4dbd-976f-cdff252a8c96" released by "delete_volume" :: held 0.976s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created reservations ['4a247982-dec4-4a8c-978f-f6973d4c5d64', '1b773507-2240-4d09-9211-81e496115035', 'c3b5093f-3ac2-4fee-b992-bf2cdefe0b4f', '97a0c959-5050-4885-8a23-ef41576b2fe7'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:38 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:38 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a04e8278-ecd8-405d-b7e3-0c0c47a03c49: deleting Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a04e8278-ecd8-405d-b7e3-0c0c47a03c49: deleting {{(pid=82295) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-3242bf53-d469-4801-b00f-3546c3bc146f" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-3242bf53-d469-4801-b00f-3546c3bc146f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Deleting offline snapshot 3242bf53-d469-4801-b00f-3546c3bc146f of volume 01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:38 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] snapshot_file for this snap is: volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-826c8d53-160d-48c6-8b71-8446ca530650-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f771e76-8028-4870-b9a8-0a0ebded2e8c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.021s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1078083603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a628f561-7a32-405b-ab8d-4c5a27f9b6b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:28Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Creating volume a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:38 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-826c8d53-160d-48c6-8b71-8446ca530650-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:38 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 1073741824 Apr 13 09:46:38 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771937bb-b354-45a6-9893-ea8630540618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb41ffe9-bcf9-40f8-aa87-01a1b08cfb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:38 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Volume volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 (384510f0-3ec6-4f7b-ba2e-d918b11d61d6): created successfully Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb41ffe9-bcf9-40f8-aa87-01a1b08cfb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:38 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Flow 'volume_create_manager' (fe86b0b8-aee8-47d9-a343-547684eba664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:39 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-faccad1e-1b52-4e22-b4d8-91194b82d2c7 tempest-CinderUnicodeTest-576878773 None] Created volume successfully. Apr 13 09:46:39 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f Apr 13 09:46:39 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "cinder-quobyte-826c8d53-160d-48c6-8b71-8446ca530650" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-826c8d53-160d-48c6-8b71-8446ca530650" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b6426d-8101-4a8d-9715-403dbc348418]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:39 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 Apr 13 09:46:39 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:39 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:39 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Deleted volume successfully. Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-59faa211-922a-46fa-aa55-bde9887d37a8 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-625cc326-d037-4dbd-976f-cdff252a8c96-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:39 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f" returned: 0 in 0.554s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5fed0d-4e1b-475a-823e-94f8b2a880dc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:39 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 1073741824" returned: 0 in 0.570s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:39 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc Apr 13 09:46:39 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:39 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:39 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:39 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650" returned: 0 in 0.522s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:39 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650 Apr 13 09:46:39 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:39 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" returned: 0 in 0.502s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:39 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f Apr 13 09:46:39 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:39 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Attempting download of 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume a628f561-7a32-405b-ab8d-4c5a27f9b6b6. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3d146b-c742-4f39-bdf3-9d7c2022b0ce]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:40 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-826c8d53-160d-48c6-8b71-8446ca530650" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-quobyte-826c8d53-160d-48c6-8b71-8446ca530650" released by "delete_volume" :: held 1.058s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Created reservations ['ebd4efc0-7cc7-467d-bdd9-800152dfabe7', '68b9dc00-4bb5-45ba-a38c-d69907d23fd2', 'aeb26de6-4c12-4fe9-9896-a7026a1346fb', 'def1f147-0f37-407c-b968-f1071a082834'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:40 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s Apr 13 09:46:40 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:40 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:40 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Creating offline snapshot 041ecb0c-bafa-4a18-b6fc-73d2983bb5cb of volume 384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be2e4f3-56bc-41c7-97ff-f013602fc57b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:40 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 Apr 13 09:46:40 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:40 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f" returned: 0 in 0.575s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:40 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f Apr 13 09:46:40 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:40 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s" returned: 0 in 0.533s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:40 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s Apr 13 09:46:40 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:40 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.527s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:40 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Deleted volume successfully. Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18b7ba20-258a-4c77-b786-c364362a2453 tempest-CreateVolumesFromSourceVolumeTest-1273611788 None] Lock "cinder-826c8d53-160d-48c6-8b71-8446ca530650-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:40 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" returned: 0 in 0.543s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:40 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb 1G Apr 13 09:46:40 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:40 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc.3242bf53-d469-4801-b00f-3546c3bc146f" returned: 0 in 0.465s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-3242bf53-d469-4801-b00f-3546c3bc146f" released by "_delete_snapshot" :: held 2.155s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" released by "delete_snapshot" :: held 2.167s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-59fc015d-f46a-4533-a9ca-82f200c6951b" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-59fc015d-f46a-4533-a9ca-82f200c6951b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-c494c434-5d24-4aa6-96e7-e2471f010593" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-c494c434-5d24-4aa6-96e7-e2471f010593" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Deleting offline snapshot c494c434-5d24-4aa6-96e7-e2471f010593 of volume 59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] snapshot_file for this snap is: volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc55dc07-b953-406f-87df-8d0befcbd7da]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:41 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 Apr 13 09:46:41 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:41 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s" returned: 1 in 0.606s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_168ef6f7-3a65-468d-bd46-416aedea31b3_6f6cwr0s' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67b4ef7-fb36-4aa5-9528-3d4e56ab9e93]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:41 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD Apr 13 09:46:41 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:41 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb 1G" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:41 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb Apr 13 09:46:41 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:41 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593" returned: 0 in 0.629s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fc015d-f46a-4533-a9ca-82f200c6951b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c304288-c59d-4a7e-9af4-32d2274606a1]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:41 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD" returned: 0 in 0.577s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] 168ef6f7-3a65-468d-bd46-416aedea31b3 was qcow2, converting to raw {{(pid=82295) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 09:46:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:41 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b Apr 13 09:46:41 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:41 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:41 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:42 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" returned: 0 in 0.565s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:42 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb is being set with open permissions: ugo+rw Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:42 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb Apr 13 09:46:42 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:42 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b" returned: 0 in 0.605s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:42 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 Apr 13 09:46:42 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:42 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" returned: 0 in 0.448s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:42 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info Apr 13 09:46:42 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:42 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 0 in 1.053s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_168ef6f7-3a65-468d-bd46-416aedea31b3_o7p09qsndevstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:46:42 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Converted 112.00 MB image at 106.26 MB/s Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:42 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593" returned: 0 in 0.536s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:42 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 1G Apr 13 09:46:42 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:42 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593 Apr 13 09:46:42 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:42 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info" returned: 0 in 0.454s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:43 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info is being set with open permissions: ugo+rw Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:43 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info Apr 13 09:46:43 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:43 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 1G" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ec6aa8-e4a0-496a-be44-17f45dec12f0]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:43 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b.c494c434-5d24-4aa6-96e7-e2471f010593" returned: 0 in 0.451s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-c494c434-5d24-4aa6-96e7-e2471f010593" released by "_delete_snapshot" :: held 2.278s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-59fc015d-f46a-4533-a9ca-82f200c6951b" released by "delete_snapshot" :: held 2.288s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:43 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:43 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:43 devstack cinder-volume[82295]: WARNING cinder.quota [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1537521889 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1537521889, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:43 devstack cinder-volume[82295]: WARNING cinder.quota [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1537521889 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1537521889, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['c66d9e71-73b2-4167-b1e2-91c19c9dc71e', '73ea0f61-996f-4f0a-8c28-87853050dba1', '04e124a0-beb3-4f25-bbf7-ea9e876990c5', 'fb6d218e-a702-44c4-936b-da504e9bf807'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:43 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.info" returned: 0 in 0.411s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:43 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-160769e5-8797-477e-95e0-ce03ddbe3275 tempest-CinderUnicodeTest-576878773 None] Create snapshot completed successfully Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['bd77a703-22c8-4d1c-bec5-636e4667c44b', '2a2cce0e-cae7-4d9c-8554-31ede584e02f', 'bc67e6d2-fc0b-489b-9a71-3f33952e7e82', 'ce4c5025-a0c7-4ac9-aa8d-1c450b859754'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:43 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3562e948-477e-4644-8ef2-2942c7154d81 tempest-GroupSnapshotsTest-775201994 None] group_snapshot a04e8278-ecd8-405d-b7e3-0c0c47a03c49: deleted successfully Apr 13 09:46:43 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 0 in 0.504s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:43 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:43 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:44 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 1 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Downloaded image 168ef6f7-3a65-468d-bd46-416aedea31b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}])) to volume a628f561-7a32-405b-ab8d-4c5a27f9b6b6 successfully. {{(pid=82295) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Temporary image 168ef6f7-3a65-468d-bd46-416aedea31b3 for user 1ffdb2d92b1244679a73233bf43df721 is deleted. {{(pid=82295) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.volume_utils [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Marking volume a628f561-7a32-405b-ab8d-4c5a27f9b6b6 as bootable. {{(pid=82295) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Copying metadata from image 168ef6f7-3a65-468d-bd46-416aedea31b3 to a628f561-7a32-405b-ab8d-4c5a27f9b6b6. {{(pid=82295) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Creating volume glance metadata for volume a628f561-7a32-405b-ab8d-4c5a27f9b6b6 backed by image 168ef6f7-3a65-468d-bd46-416aedea31b3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82295) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb0dcef-da23-40f9-9e7f-e18d7d2a642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6', 'volume_size': 1, 'image_id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/168ef6f7-3a65-468d-bd46-416aedea31b3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c033fc03c63a4723af0f657b660e8d66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '168ef6f7-3a65-468d-bd46-416aedea31b3', 'created_at': datetime.datetime(2026, 4, 13, 7, 36, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 7, 36, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/168ef6f7-3a65-468d-bd46-416aedea31b3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18c2ffd-adb7-47c1-b3b9-c52d31df7a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:44 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Volume volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 (a628f561-7a32-405b-ab8d-4c5a27f9b6b6): created successfully Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18c2ffd-adb7-47c1-b3b9-c52d31df7a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (749fec8d-7670-43e5-9836-cf6cfaeb255c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:44 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cff9e748-1241-40b1-a6a3-cdabe4c989ed tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7b65a4-7e27-4cf4-91cb-6840bcdf1fbf]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-041ecb0c-bafa-4a18-b6fc-73d2983bb5cb-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-041ecb0c-bafa-4a18-b6fc-73d2983bb5cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-quobyte-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-quobyte-041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Deleting offline snapshot 041ecb0c-bafa-4a18-b6fc-73d2983bb5cb of volume 384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] snapshot_file for this snap is: volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:44 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc Apr 13 09:46:44 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d69de-332d-4ddf-8fdc-8e04aa3fa78c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:44 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb Apr 13 09:46:44 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:45 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" returned: 0 in 0.527s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:45 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc Apr 13 09:46:45 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:45 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" returned: 0 in 0.532s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aaaf13-c15f-4119-8c43-5aa3950a80bf]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:45 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 Apr 13 09:46:45 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:45 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" returned: 0 in 0.522s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-01d1c9a0-32dc-4f63-bacb-bf536e43fddc" released by "delete_volume" :: held 1.095s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-59fc015d-f46a-4533-a9ca-82f200c6951b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-59fc015d-f46a-4533-a9ca-82f200c6951b" acquired by "delete_volume" :: waited 0.022s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d84b78e-b68f-4c64-8f38-85937d1a26b8]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (8db7040d-98ea-45da-a66e-5c2bb2512c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37e6ac7-f8ae-41f2-82e5-9f98c0db5688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:45 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b Apr 13 09:46:45 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37e6ac7-f8ae-41f2-82e5-9f98c0db5688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1801715967',display_name='tempest-VolumesGetTest-Volume-1338137095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05af0409-f9ce-49bc-825d-cc0bc97420f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:46Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f349fce-1965-42cb-a0a5-0bf728df42f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f349fce-1965-42cb-a0a5-0bf728df42f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecefc8f-6b7e-48fa-8a6b-fcb6fa7cc1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecefc8f-6b7e-48fa-8a6b-fcb6fa7cc1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05af0409-f9ce-49bc-825d-cc0bc97420f8', 'volume_name': 'volume-05af0409-f9ce-49bc-825d-cc0bc97420f8', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b8091d-6f89-4ddb-b278-557ac533cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b8091d-6f89-4ddb-b278-557ac533cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890ae3a2-8512-4864-a4c8-b7da78a30015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:45 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:45 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Volume 05af0409-f9ce-49bc-825d-cc0bc97420f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05af0409-f9ce-49bc-825d-cc0bc97420f8', 'volume_size': 1} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1801715967',display_name='tempest-VolumesGetTest-Volume-1338137095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05af0409-f9ce-49bc-825d-cc0bc97420f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99cb08b83e554f699088e4eff3c9f2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:46Z,use_quota=True,user_id='1ffdb2d92b1244679a73233bf43df721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Creating volume 05af0409-f9ce-49bc-825d-cc0bc97420f8 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:45 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" returned: 0 in 0.606s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:45 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 1073741824 Apr 13 09:46:45 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:45 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb Apr 13 09:46:45 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:46 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:46 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b Apr 13 09:46:46 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:46 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" returned: 0 in 0.505s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:46 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb Apr 13 09:46:46 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:46 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 1073741824" returned: 0 in 0.550s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:46 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 Apr 13 09:46:46 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:46 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-59fc015d-f46a-4533-a9ca-82f200c6951b" returned: 0 in 0.449s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-59fc015d-f46a-4533-a9ca-82f200c6951b" released by "delete_volume" :: held 1.010s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['0604e11f-3a8b-4eb7-b607-794041e2d314'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:46 devstack cinder-volume[82295]: WARNING cinder.quota [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1537521889 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1537521889, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['4ee8c090-ad7a-41cd-b88e-0903dd7b8e7e', '9b79b2e3-c47a-41a7-a159-7453fe1837c2', '911c5731-f8c6-475d-ae5a-6ac9866ac9de', '897fc1a4-cd1a-4521-a122-5c971bae9ad5'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:46 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8" returned: 0 in 0.460s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:46 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890ae3a2-8512-4864-a4c8-b7da78a30015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05af0409-f9ce-49bc-825d-cc0bc97420f8', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5bd198-389c-40aa-8baa-5f5f2f775585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6.041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" returned: 0 in 0.549s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['851f9b9f-2abd-47c6-b9f3-2987dd815511', 'e1ec3161-33e1-473f-bb27-5047e28b9418', 'd85bbd9f-beab-4542-a499-de487bef1fbd', 'd5bc8cbc-6eef-4fcb-85e6-02fa30bf7ffa'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Volume volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 (05af0409-f9ce-49bc-825d-cc0bc97420f8): created successfully Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5bd198-389c-40aa-8baa-5f5f2f775585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Flow 'volume_create_manager' (8db7040d-98ea-45da-a66e-5c2bb2512c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:46 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d3733823-a06b-4622-8c7c-fc4c4857a7ff tempest-VolumesGetTest-194080950 None] Created volume successfully. Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-041ecb0c-bafa-4a18-b6fc-73d2983bb5cb" released by "_delete_snapshot" :: held 2.280s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" released by "delete_snapshot" :: held 2.303s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Created reservations ['bcb33e2c-3a6c-40c6-8652-566c2d298a99', 'f3f9da8a-d822-4e62-9e68-06fefa5f817f', 'bf6b68bd-4d8f-4e66-bbb1-74ee7a4f15a7', '05f370e1-23e0-4fda-bdad-8f7bf8f0f631'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:46 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:46 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:46 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Delete snapshot completed successfully. Apr 13 09:46:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fba63430-04a6-4ab1-a8de-f6aecf579739 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-041ecb0c-bafa-4a18-b6fc-73d2983bb5cb-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:47 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.417s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f83b5a7f-e36b-4140-b144-e2c5d14fdd95 tempest-GroupSnapshotsTest-775201994 None] Delete group completed successfully. Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-384510f0-3ec6-4f7b-ba2e-d918b11d61d6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Lock "cinder-384510f0-3ec6-4f7b-ba2e-d918b11d61d6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-quobyte-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec66c8e6-49b9-4e93-8ede-8071c14920cb]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-05af0409-f9ce-49bc-825d-cc0bc97420f8-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Lock "cinder-05af0409-f9ce-49bc-825d-cc0bc97420f8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:47 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 Apr 13 09:46:47 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-05af0409-f9ce-49bc-825d-cc0bc97420f8" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-05af0409-f9ce-49bc-825d-cc0bc97420f8" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[278efa4a-d169-40d7-aafd-019c5000d0f7]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:48 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 Apr 13 09:46:48 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fe5189b1-a259-4c66-8456-bf6f09fff59f tempest-GroupSnapshotsTest-775201994 None] Group tempest-GroupSnapshotsTest-Group-16236802: creating Apr 13 09:46:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fe5189b1-a259-4c66-8456-bf6f09fff59f tempest-GroupSnapshotsTest-775201994 None] Group tempest-GroupSnapshotsTest-Group-16236802: created successfully Apr 13 09:46:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fe5189b1-a259-4c66-8456-bf6f09fff59f tempest-GroupSnapshotsTest-775201994 None] Create group completed successfully. Apr 13 09:46:48 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" returned: 0 in 0.523s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:48 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6 Apr 13 09:46:48 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:48 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8" returned: 0 in 0.492s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:48 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8 Apr 13 09:46:48 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:48 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" returned: 0 in 0.422s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-384510f0-3ec6-4f7b-ba2e-d918b11d61d6" released by "delete_volume" :: held 0.980s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Created reservations ['bbb7550c-b0dc-44b4-9f97-49cff877d544', '4d29b247-0478-4a29-b767-608db096c3b8', 'ac7109fd-04ef-48a0-9ebf-3fabc87b1fa6', 'e89f4595-1d7d-4021-b1c2-39fde86230c5'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:48 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-05af0409-f9ce-49bc-825d-cc0bc97420f8" returned: 0 in 0.421s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-05af0409-f9ce-49bc-825d-cc0bc97420f8" released by "delete_volume" :: held 0.940s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:48 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:48 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-692eef38-e88e-445a-af6e-b026e19d148b-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-692eef38-e88e-445a-af6e-b026e19d148b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:48 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Created reservations ['6a8e4bbc-8440-49cf-a1cd-24451b4da38b', '92ffa4c0-8bdb-46b5-8336-373a561e7c58', 'ce3e3685-9574-4070-8b88-1a2379404849', '0931a4c2-76c6-4acd-bd76-41428065eb73'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "cinder-quobyte-692eef38-e88e-445a-af6e-b026e19d148b" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-692eef38-e88e-445a-af6e-b026e19d148b" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[101cf178-5019-41f2-8246-a7c409fa8e1e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:49 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:49 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:49 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b Apr 13 09:46:49 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:49 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.522s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Deleted volume successfully. Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8e3ca1d3-532d-4d0d-aa04-57103475a92a tempest-CinderUnicodeTest-576878773 None] Lock "cinder-384510f0-3ec6-4f7b-ba2e-d918b11d61d6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (f5dce12c-2d73-4f01-a4f2-c482942565f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8d5033-a9a9-43d9-8074-465a9e221098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8d5033-a9a9-43d9-8074-465a9e221098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211607993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87e34726-32f3-426a-b420-83d3c383d3b0,host='devstack@QuobyteHD#QuobyteHD',id=4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:50Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb72e20f-e38a-4849-bd1f-545cb8512125),volume_type_id=bb72e20f-e38a-4849-bd1f-545cb8512125)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c1a18d-8f4e-4267-920e-e8f5e3e1a3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c1a18d-8f4e-4267-920e-e8f5e3e1a3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dc5e8a-8380-425f-87be-7a34bb35de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7dc5e8a-8380-425f-87be-7a34bb35de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d', 'volume_name': 'volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:49 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6aef55-69e4-498d-8879-892f00c32f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6aef55-69e4-498d-8879-892f00c32f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d73ae30-6a1d-474a-b95f-f693d9831b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Volume 4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d', 'volume_size': 1} Apr 13 09:46:49 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=87e34726-32f3-426a-b420-83d3c383d3b0,created_at=2026-04-13T07:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211607993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87e34726-32f3-426a-b420-83d3c383d3b0,host='devstack@QuobyteHD#QuobyteHD',id=4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f459f61fbe4e97a139e7134146835b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:50Z,use_quota=True,user_id='a91acb609f7f4d39baf06f48db7b8390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb72e20f-e38a-4849-bd1f-545cb8512125),volume_type_id=bb72e20f-e38a-4849-bd1f-545cb8512125)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Creating volume 4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:49 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.541s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b" returned: 0 in 0.567s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:49 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d 1073741824 Apr 13 09:46:49 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:46:49 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b Apr 13 09:46:49 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-051b118b-3bd3-4954-a09a-718ecb404bd1 tempest-VolumesGetTest-194080950 None] Lock "cinder-05af0409-f9ce-49bc-825d-cc0bc97420f8-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:50 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-692eef38-e88e-445a-af6e-b026e19d148b" returned: 0 in 0.464s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-quobyte-692eef38-e88e-445a-af6e-b026e19d148b" released by "delete_volume" :: held 1.057s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:50 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d 1073741824" returned: 0 in 0.503s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-a628f561-7a32-405b-ab8d-4c5a27f9b6b6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:50 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d Apr 13 09:46:50 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Created reservations ['1c36a30b-3a51-46e6-8895-bb9f401c5fea', 'ea52829e-f6c9-451a-a80d-c368187394b3', '0254baf3-46f8-4c43-b008-3ff89456ab0e', '73a8de7e-27b8-48a5-b68a-c7743bf9314e'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Lock "cinder-a628f561-7a32-405b-ab8d-4c5a27f9b6b6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:50 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:50 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Acquiring lock "cinder-quobyte-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fde3a0f-fba2-431e-b40f-85e32eab0a5e]: (4, 'raw') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:50 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:50 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:50 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d73ae30-6a1d-474a-b95f-f693d9831b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38e2b13-d0b0-4e5b-ae68-6df5f4863eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:50 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Volume volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d (4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d): created successfully Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38e2b13-d0b0-4e5b-ae68-6df5f4863eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Flow 'volume_create_manager' (f5dce12c-2d73-4f01-a4f2-c482942565f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-55d08d17-b320-40ec-9ee9-9898b27f16a3 tempest-GroupSnapshotsTest-775201994 None] Created volume successfully. Apr 13 09:46:50 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.455s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Deleted volume successfully. Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bc0df99b-e2a8-4267-b733-3cfbc75d0235 tempest-CinderUnicodeTest-576878773 None] Lock "cinder-692eef38-e88e-445a-af6e-b026e19d148b-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:50 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 0 in 0.513s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:50 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:50 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:51 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 1 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6' failed. Not Retrying. {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:51 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6 Apr 13 09:46:51 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:51 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Lock "cinder-quobyte-a628f561-7a32-405b-ab8d-4c5a27f9b6b6" released by "delete_volume" :: held 1.556s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Created reservations ['b10f02d4-7a93-481e-b807-95e358d28e31', '7ee935d1-8990-4ac6-91c7-e0188f215cc0', 'fce7c7ec-e3cd-4999-af6f-8d9c72ec372b', '2631ad0c-823e-43e0-82fe-27615ff681e0'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:51 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] GroupSnapshot 122b7020-b22e-40e8-ab58-c6300b131a90: creating. Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Group snapshot 122b7020-b22e-40e8-ab58-c6300b131a90: creating. {{(pid=82295) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Creating offline snapshot d52e5572-d860-4fbc-9339-90a3c1e1b569 of volume 4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b34de17-bf51-4322-bbfd-792331f85565]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:52 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:46:52 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:52 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d Apr 13 09:46:52 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:52 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:46:52 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Deleted volume successfully. Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f9d79680-b234-4061-bb82-a2f815c7d6cd tempest-VolumesGetTest-194080950 None] Lock "cinder-a628f561-7a32-405b-ab8d-4c5a27f9b6b6-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:52 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" returned: 0 in 0.577s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:52 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 1G Apr 13 09:46:52 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:53 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 1G" returned: 0 in 0.527s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:53 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 Apr 13 09:46:53 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:53 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:53 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:53 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 Apr 13 09:46:53 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:54 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:54 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info Apr 13 09:46:54 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (09fbcab1-6d63-401b-b490-81144bb0dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a21ea7-fe16-49f4-9100-215d16eb23ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a21ea7-fe16-49f4-9100-215d16eb23ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-325943094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3af7d6-3142-40dd-a5b2-346b0d601ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc0f591a3443a0845c1827ba93f623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:54Z,use_quota=True,user_id='f93aa62973f44827ae52892615cb1cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a54189e-421d-4c6d-851e-5f599b3d9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a54189e-421d-4c6d-851e-5f599b3d9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca5c3c0-801d-4e38-86b0-5aef523220ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca5c3c0-801d-4e38-86b0-5aef523220ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3af7d6-3142-40dd-a5b2-346b0d601ca9', 'volume_name': 'volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d97b62f-65d8-4934-8487-9f5ba918f180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d97b62f-65d8-4934-8487-9f5ba918f180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c4988f-a620-4adb-9d53-30fd1ad62362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:54 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Volume 6b3af7d6-3142-40dd-a5b2-346b0d601ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9', 'volume_size': 1} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:54 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info" returned: 0 in 0.430s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:54 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:54 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info Apr 13 09:46:54 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:54 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.info" returned: 0 in 0.438s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.047s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-325943094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3af7d6-3142-40dd-a5b2-346b0d601ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc0f591a3443a0845c1827ba93f623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:46:54Z,use_quota=True,user_id='f93aa62973f44827ae52892615cb1cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Creating volume 6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:46:55 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:55 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 1073741824 Apr 13 09:46:55 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:55 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3ac27767-9631-4e50-af4b-9d2384894fd6 tempest-GroupSnapshotsTest-775201994 None] group_snapshot 122b7020-b22e-40e8-ab58-c6300b131a90: created successfully Apr 13 09:46:55 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 1073741824" returned: 0 in 0.518s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:55 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:46:55 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:55 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.417s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c4988f-a620-4adb-9d53-30fd1ad62362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9361a8c-b406-4ffd-be4e-80abc14b2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:55 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Volume volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 (6b3af7d6-3142-40dd-a5b2-346b0d601ca9): created successfully Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9361a8c-b406-4ffd-be4e-80abc14b2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:46:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (09fbcab1-6d63-401b-b490-81144bb0dccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:56 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7ffa69b8-8f99-4e1e-b700-ba5979de4a5d tempest-VolumeDependencyTests-310108007 None] Created volume successfully. Apr 13 09:46:56 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] group_snapshot 122b7020-b22e-40e8-ab58-c6300b131a90: deleting Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] group_snapshot 122b7020-b22e-40e8-ab58-c6300b131a90: deleting {{(pid=82295) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-d52e5572-d860-4fbc-9339-90a3c1e1b569" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d52e5572-d860-4fbc-9339-90a3c1e1b569" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Deleting offline snapshot d52e5572-d860-4fbc-9339-90a3c1e1b569 of volume 4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] snapshot_file for this snap is: volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb072ece-7c98-4fe6-8ae7-397cc0c1c973]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:56 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 Apr 13 09:46:56 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Creating offline snapshot 8fbe1fed-00d8-4fe1-af50-e097f817a47d of volume 6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b908a-d239-4717-a43c-21c7a9d8e41a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:56 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:46:56 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:56 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569" returned: 0 in 0.537s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b38d2-8099-4403-a0cf-894e1ad82b81]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:56 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d Apr 13 09:46:56 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:57 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.512s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:57 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d 1G Apr 13 09:46:57 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:57 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:57 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 Apr 13 09:46:57 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:57 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d 1G" returned: 0 in 0.530s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:57 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d Apr 13 09:46:57 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:57 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:57 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569 Apr 13 09:46:57 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:57 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d" returned: 0 in 0.460s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:58 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d is being set with open permissions: ugo+rw Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:58 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d Apr 13 09:46:58 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:58 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d.d52e5572-d860-4fbc-9339-90a3c1e1b569" returned: 0 in 0.439s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-d52e5572-d860-4fbc-9339-90a3c1e1b569" released by "_delete_snapshot" :: held 2.054s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" released by "delete_snapshot" :: held 2.073s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:46:58 devstack cinder-volume[82295]: WARNING cinder.quota [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-572274460 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-572274460, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:58 devstack cinder-volume[82295]: WARNING cinder.quota [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-572274460 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-572274460, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] Created reservations ['04cd8a3f-0554-4267-ace0-381a44a04567', '95e4cc6f-a269-49fe-a0f7-7f3b62706127', '96509ff3-d00a-45cf-871f-84c22c32eafc', '7243cefa-eced-45c8-97e7-07afd729a48f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:46:58 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8f1c2a14-ab4f-4568-afa7-b29eb99068f4 tempest-GroupSnapshotsTest-775201994 None] group_snapshot 122b7020-b22e-40e8-ab58-c6300b131a90: deleted successfully Apr 13 09:46:58 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d" returned: 0 in 0.466s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:58 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info Apr 13 09:46:58 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:58 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info" returned: 0 in 0.421s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:58 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info is being set with open permissions: ugo+rw Apr 13 09:46:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:58 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info Apr 13 09:46:58 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:59 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.info" returned: 0 in 0.408s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:46:59 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fc3e502d-f997-4d1c-aeff-b3c421aa7e7d tempest-VolumeDependencyTests-310108007 None] Create snapshot completed successfully Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "cinder-quobyte-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701ebef-af5f-40e0-a688-de2a3777baac]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:46:59 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d Apr 13 09:46:59 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (72f5d2bf-7f8b-40cb-a284-abfc79b76d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25475e6a-c1bd-484d-a880-bfdec92415fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:46:59 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25475e6a-c1bd-484d-a880-bfdec92415fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-738974247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38b4b58-bc27-4701-a926-05b39a700ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc0f591a3443a0845c1827ba93f623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fbe1fed-00d8-4fe1-af50-e097f817a47d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:00Z,use_quota=True,user_id='f93aa62973f44827ae52892615cb1cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbf4e4e-f39f-4d42-89a5-3cf7a65f6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbf4e4e-f39f-4d42-89a5-3cf7a65f6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563fd75b-3652-493a-8452-bc6e1c901764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563fd75b-3652-493a-8452-bc6e1c901764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f38b4b58-bc27-4701-a926-05b39a700ba6', 'volume_name': 'volume-f38b4b58-bc27-4701-a926-05b39a700ba6', 'volume_size': 1, 'snapshot_id': '8fbe1fed-00d8-4fe1-af50-e097f817a47d'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1227b793-f962-4f25-a125-ffba6c802c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1227b793-f962-4f25-a125-ffba6c802c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276c2d00-2617-48dd-a065-675cdfdc404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:00 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Volume f38b4b58-bc27-4701-a926-05b39a700ba6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f38b4b58-bc27-4701-a926-05b39a700ba6', 'volume_size': 1, 'snapshot_id': '8fbe1fed-00d8-4fe1-af50-e097f817a47d'} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-8fbe1fed-00d8-4fe1-af50-e097f817a47d-f38b4b58-bc27-4701-a926-05b39a700ba6" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-8fbe1fed-00d8-4fe1-af50-e097f817a47d-f38b4b58-bc27-4701-a926-05b39a700ba6" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Creating volume f38b4b58-bc27-4701-a926-05b39a700ba6 from snapshot 8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-f38b4b58-bc27-4701-a926-05b39a700ba6" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-f38b4b58-bc27-4701-a926-05b39a700ba6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] snapshot: 8fbe1fed-00d8-4fe1-af50-e097f817a47d, volume: f38b4b58-bc27-4701-a926-05b39a700ba6, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d950e19-fee5-4087-97a1-c6ac2213d0e5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:00 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d Apr 13 09:47:00 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:00 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" returned: 0 in 0.574s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:00 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d Apr 13 09:47:00 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:00 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:00 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:00 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d" returned: 0 in 0.514s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfee4f-6abd-439f-a8ab-fd87bb1c3560]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:00 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:00 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:47:00 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Lock "cinder-quobyte-4fcfebf8-3794-4bb6-84a2-9b8c96bdfc6d" released by "delete_volume" :: held 1.056s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Created reservations ['3ea126f6-ab53-44d3-b24b-31bf5cf8729b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:00 devstack cinder-volume[82295]: WARNING cinder.quota [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-572274460 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-572274460, it is now deprecated. Please use the default quota class for default quota. Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Created reservations ['3c0a30d2-56f3-4ac6-aee3-0f5242d06dfc', '592f6d40-7108-4216-a53b-844b41079075', '488bdebc-c2bb-42fd-8795-ba54619a9407', '31985ffb-b5da-4c76-a960-38e89602cb60'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:00 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:00 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:00 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:01 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:01 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:47:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:01 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 Apr 13 09:47:01 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:01 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.432s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-def2ef7d-7d66-4278-a6fd-72f0ceaa0b0d tempest-GroupSnapshotsTest-775201994 None] Delete group completed successfully. Apr 13 09:47:03 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6" returned: 0 in 2.397s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:03 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c614e3-dc85-418f-b656-fa439d6584bc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:03 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:47:03 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:04 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.714s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:47:04 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Converted 1024.00 MB image at 427.04 MB/s Apr 13 09:47:04 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 is being set with open permissions: ugo+rw Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:04 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 Apr 13 09:47:04 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:04 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6" returned: 0 in 0.476s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-f38b4b58-bc27-4701-a926-05b39a700ba6" released by "_copy_volume_from_snapshot" :: held 4.675s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-8fbe1fed-00d8-4fe1-af50-e097f817a47d-f38b4b58-bc27-4701-a926-05b39a700ba6" released by "_create_volume_from_snapshot" :: held 4.693s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.702s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276c2d00-2617-48dd-a065-675cdfdc404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38b4b58-bc27-4701-a926-05b39a700ba6', 'volume_size': 1, 'snapshot_id': '8fbe1fed-00d8-4fe1-af50-e097f817a47d'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef863cfb-d963-41a1-8110-78eba0e3d5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:04 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Volume volume-f38b4b58-bc27-4701-a926-05b39a700ba6 (f38b4b58-bc27-4701-a926-05b39a700ba6): created successfully Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef863cfb-d963-41a1-8110-78eba0e3d5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (72f5d2bf-7f8b-40cb-a284-abfc79b76d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7853a3d1-ccab-410a-905a-809646849fb6 tempest-VolumeDependencyTests-310108007 None] Created volume successfully. Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-8fbe1fed-00d8-4fe1-af50-e097f817a47d-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-8fbe1fed-00d8-4fe1-af50-e097f817a47d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-8fbe1fed-00d8-4fe1-af50-e097f817a47d" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-8fbe1fed-00d8-4fe1-af50-e097f817a47d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Deleting offline snapshot 8fbe1fed-00d8-4fe1-af50-e097f817a47d of volume 6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] snapshot_file for this snap is: volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[836aa032-d937-4eb9-8923-7b893954ccdc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:05 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d Apr 13 09:47:05 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:05 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d" returned: 0 in 0.531s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cda587-7534-45d6-bd56-a0a02c8e3b11]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:06 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:47:06 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:06 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.547s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:06 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d Apr 13 09:47:06 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:07 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d" returned: 0 in 0.563s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:07 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d Apr 13 09:47:07 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:07 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9.8fbe1fed-00d8-4fe1-af50-e097f817a47d" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-8fbe1fed-00d8-4fe1-af50-e097f817a47d" released by "_delete_snapshot" :: held 2.219s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" released by "delete_snapshot" :: held 2.232s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Created reservations ['0b8dd27e-f5a5-4b3b-9991-dc5c62bb6621', '0222bc35-6d4c-45de-a659-c86929d7c78a', 'b255b9a4-06a2-480e-bb5a-97d873b37ec0', 'd5a08ac5-ea2d-4c18-a1b4-23e41d745f4c'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Delete snapshot completed successfully. Apr 13 09:47:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-492acd3b-8d67-46cd-bb3a-54334bff7e32 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-8fbe1fed-00d8-4fe1-af50-e097f817a47d-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-6b3af7d6-3142-40dd-a5b2-346b0d601ca9-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-6b3af7d6-3142-40dd-a5b2-346b0d601ca9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:08 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7adba4-1341-4ed4-8692-12d3c56ab6a8]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:08 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:47:08 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:09 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.553s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:09 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9 Apr 13 09:47:09 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Flow 'volume_create_manager' (fe4b70d9-8a59-4a88-a024-ac9b688c0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3252d93b-50b9-4981-9129-a5a9dd36e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3252d93b-50b9-4981-9129-a5a9dd36e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-873682492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f4c1c-b81a-4c12-bf77-c6eb6327dfdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3e53a5e6094ef4a6dfa0dbab7fa86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:09Z,use_quota=True,user_id='0cca491b5e274206b679592b4e047582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9b5672-6f35-4ef2-a649-dec52183da0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9b5672-6f35-4ef2-a649-dec52183da0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6aae9-46e6-48c1-bfbe-d5becb86886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6aae9-46e6-48c1-bfbe-d5becb86886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694f4c1c-b81a-4c12-bf77-c6eb6327dfdd', 'volume_name': 'volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735fe284-5135-4355-9e2d-14ffcd1101cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735fe284-5135-4355-9e2d-14ffcd1101cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07d96dc-d17f-4f1b-94ea-8f45e5634ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:09 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd', 'volume_size': 1} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-873682492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f4c1c-b81a-4c12-bf77-c6eb6327dfdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3e53a5e6094ef4a6dfa0dbab7fa86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:09Z,use_quota=True,user_id='0cca491b5e274206b679592b4e047582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Creating volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:47:09 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:09 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd 1073741824 Apr 13 09:47:09 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:09 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" returned: 0 in 0.450s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-6b3af7d6-3142-40dd-a5b2-346b0d601ca9" released by "delete_volume" :: held 1.035s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Created reservations ['e0be7a0c-77e3-4938-af7e-3085b0135742', '31e12cc9-ae1b-4bcd-a82b-06d0eb482104', 'f6ac2461-4c15-40ea-9964-026e48fa6681', '259cda13-b464-4f99-bd6b-ca5233671662'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:09 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:09 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:09 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd 1073741824" returned: 0 in 0.552s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:09 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd Apr 13 09:47:09 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:10 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:10 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Deleted volume successfully. Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-4a968452-0717-49f0-90ad-94ab2ce14895 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-6b3af7d6-3142-40dd-a5b2-346b0d601ca9-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:10 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07d96dc-d17f-4f1b-94ea-8f45e5634ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0ec5b9-1c11-4d62-851a-157a7fac1dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:10 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Volume volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd (694f4c1c-b81a-4c12-bf77-c6eb6327dfdd): created successfully Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0ec5b9-1c11-4d62-851a-157a7fac1dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Flow 'volume_create_manager' (fe4b70d9-8a59-4a88-a024-ac9b688c0042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:10 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8a17e89d-b472-4790-a5f6-e09d18b3a791 tempest-SnapshotsActionsTest-476340526 None] Created volume successfully. Apr 13 09:47:10 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (4171d6e3-19d3-4c8f-be7a-6642ae1d5a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695ebd4d-1756-4eb6-85e1-3eb443e4f4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695ebd4d-1756-4eb6-85e1-3eb443e4f4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1012960441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5b19c6-a743-4a30-9ceb-97845012759e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc0f591a3443a0845c1827ba93f623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:11Z,use_quota=True,user_id='f93aa62973f44827ae52892615cb1cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83ff1cc-c166-4146-bdef-b193551720d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83ff1cc-c166-4146-bdef-b193551720d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f613f47-9623-4f6a-9d19-686383c3fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f613f47-9623-4f6a-9d19-686383c3fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5b19c6-a743-4a30-9ceb-97845012759e', 'volume_name': 'volume-7e5b19c6-a743-4a30-9ceb-97845012759e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bc225d-2d62-4810-a331-f51d1d8373ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bc225d-2d62-4810-a331-f51d1d8373ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecdf160-34ce-455c-99c7-3d68c55ae904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:11 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Volume 7e5b19c6-a743-4a30-9ceb-97845012759e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5b19c6-a743-4a30-9ceb-97845012759e', 'volume_size': 1} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1012960441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5b19c6-a743-4a30-9ceb-97845012759e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc0f591a3443a0845c1827ba93f623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:11Z,use_quota=True,user_id='f93aa62973f44827ae52892615cb1cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Creating volume 7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:47:11 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:11 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e 1073741824 Apr 13 09:47:11 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:11 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e 1073741824" returned: 0 in 0.516s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:11 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:11 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:12 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.413s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.643s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecdf160-34ce-455c-99c7-3d68c55ae904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5b19c6-a743-4a30-9ceb-97845012759e', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc13ad-80da-41d8-a7cf-e1208d38c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Creating offline snapshot 9a881c6a-36c3-4110-a9e7-5c9357ac5c53 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:12 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Volume volume-7e5b19c6-a743-4a30-9ceb-97845012759e (7e5b19c6-a743-4a30-9ceb-97845012759e): created successfully Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc13ad-80da-41d8-a7cf-e1208d38c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (4171d6e3-19d3-4c8f-be7a-6642ae1d5a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f7aac-0d59-4969-ac6d-b9ab3a2bdb9e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:12 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b6a736f0-1b58-4457-95cd-33fe2a457bf7 tempest-VolumeDependencyTests-310108007 None] Created volume successfully. Apr 13 09:47:12 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd Apr 13 09:47:12 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:12 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" returned: 0 in 0.485s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:12 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 1G Apr 13 09:47:12 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:13 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 1G" returned: 0 in 0.491s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:13 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:13 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (2b12dc14-857c-4f6d-bfea-32f24bf50243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc18d73-9b93-4a8f-bfec-be8593f83209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc18d73-9b93-4a8f-bfec-be8593f83209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1809692284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b855b98b-651f-4f3c-83a4-5281696d99fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fc0f591a3443a0845c1827ba93f623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7e5b19c6-a743-4a30-9ceb-97845012759e,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:13Z,use_quota=True,user_id='f93aa62973f44827ae52892615cb1cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4833716a-25ae-415d-b362-35010d03a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4833716a-25ae-415d-b362-35010d03a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b23fc72-1bcd-4f40-9868-8ad5b2e8349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b23fc72-1bcd-4f40-9868-8ad5b2e8349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b855b98b-651f-4f3c-83a4-5281696d99fa', 'volume_name': 'volume-b855b98b-651f-4f3c-83a4-5281696d99fa', 'volume_size': 1, 'source_volid': '7e5b19c6-a743-4a30-9ceb-97845012759e', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e7689a-3fca-4ee6-a141-f3cd320c9e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e7689a-3fca-4ee6-a141-f3cd320c9e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be46b007-eeda-41b8-8bd4-b139d2716a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:13 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Volume b855b98b-651f-4f3c-83a4-5281696d99fa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b855b98b-651f-4f3c-83a4-5281696d99fa', 'volume_size': 1, 'source_volid': '7e5b19c6-a743-4a30-9ceb-97845012759e', 'source_volstatus': 'available'} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:13 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:13 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 is being set with open permissions: ugo+rw Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:13 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:13 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:13 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.388s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:13 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info Apr 13 09:47:13 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:14 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info" returned: 0 in 0.399s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:14 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info is being set with open permissions: ugo+rw Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:14 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info Apr 13 09:47:14 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:14 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.info" returned: 0 in 0.400s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.304s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:14 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Cloning volume 7e5b19c6-a743-4a30-9ceb-97845012759e to volume b855b98b-651f-4f3c-83a4-5281696d99fa Apr 13 09:47:14 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-59ed1468-2e9b-4048-83f5-e4240dd3d9cb tempest-SnapshotsActionsTest-476340526 None] Create snapshot completed successfully Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Creating offline snapshot 6e0fe711-6a12-4264-bba8-aef89a614965 of volume 7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f82d23d-e7d9-4a3f-84c4-9ad6d4b4b1cb]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:14 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:14 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:15 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.485s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:15 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 1G Apr 13 09:47:15 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:15 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 1G" returned: 0 in 0.538s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5b19c6-a743-4a30-9ceb-97845012759e -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:15 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5b19c6-a743-4a30-9ceb-97845012759e -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 Apr 13 09:47:15 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:16 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e5b19c6-a743-4a30-9ceb-97845012759e -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965" returned: 0 in 0.428s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:16 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 is being set with open permissions: ugo+rw Apr 13 09:47:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:16 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 Apr 13 09:47:16 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:16 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965" returned: 0 in 0.410s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:16 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info Apr 13 09:47:16 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:17 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info" returned: 0 in 0.410s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:17 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info is being set with open permissions: ugo+rw Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:17 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info Apr 13 09:47:17 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:17 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.info" returned: 0 in 0.389s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-b855b98b-651f-4f3c-83a4-5281696d99fa" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-b855b98b-651f-4f3c-83a4-5281696d99fa" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] snapshot: 6e0fe711-6a12-4264-bba8-aef89a614965, volume: b855b98b-651f-4f3c-83a4-5281696d99fa, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e94785-b8ea-4c92-9bde-4463525d50e6]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:17 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 Apr 13 09:47:17 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:17 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965" returned: 0 in 0.486s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5b19c6-a743-4a30-9ceb-97845012759e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff82a66-e8de-41a6-a3ae-bf81098e89a9]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:18 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:18 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:18 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:18 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:47:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:18 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa Apr 13 09:47:18 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:20 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa" returned: 0 in 2.105s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:20 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce47e0b6-7f00-4bba-87f4-4e94980e4c39]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:20 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:20 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:21 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.590s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:47:21 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Converted 1024.00 MB image at 486.14 MB/s Apr 13 09:47:21 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa is being set with open permissions: ugo+rw Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:21 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa Apr 13 09:47:21 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:21 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa" returned: 0 in 0.402s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-b855b98b-651f-4f3c-83a4-5281696d99fa" released by "_copy_volume_from_snapshot" :: held 4.119s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-6e0fe711-6a12-4264-bba8-aef89a614965" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-6e0fe711-6a12-4264-bba8-aef89a614965" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Deleting offline snapshot 6e0fe711-6a12-4264-bba8-aef89a614965 of volume 7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] snapshot_file for this snap is: volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[31495497-8120-4c9a-a584-eec4b6d10318]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:21 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 Apr 13 09:47:21 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:22 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965" returned: 0 in 0.464s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e5b19c6-a743-4a30-9ceb-97845012759e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[059a9687-2e4d-458d-b252-a9cb843ae817]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:22 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:22 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:22 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.450s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:22 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 Apr 13 09:47:22 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:22 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:23 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965 Apr 13 09:47:23 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:23 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e.6e0fe711-6a12-4264-bba8-aef89a614965" returned: 0 in 0.428s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-6e0fe711-6a12-4264-bba8-aef89a614965" released by "_delete_snapshot" :: held 1.821s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.732s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.637s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be46b007-eeda-41b8-8bd4-b139d2716a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b855b98b-651f-4f3c-83a4-5281696d99fa', 'volume_size': 1, 'source_volid': '7e5b19c6-a743-4a30-9ceb-97845012759e', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d23fd53-a9ca-40df-857e-7838b51dfc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Creating offline snapshot 866952bd-0c73-4097-b318-50d3ba9e4510 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:23 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Volume volume-b855b98b-651f-4f3c-83a4-5281696d99fa (b855b98b-651f-4f3c-83a4-5281696d99fa): created successfully Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d23fd53-a9ca-40df-857e-7838b51dfc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Flow 'volume_create_manager' (2b12dc14-857c-4f6d-bfea-32f24bf50243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5ac764-b2d1-4b27-ae44-5f0cf7c6c664]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:23 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-dee0b7ef-7120-4c5c-81ed-cc09333b9ac2 tempest-VolumeDependencyTests-310108007 None] Created volume successfully. Apr 13 09:47:23 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:23 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-7e5b19c6-a743-4a30-9ceb-97845012759e-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Lock "cinder-7e5b19c6-a743-4a30-9ceb-97845012759e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-7e5b19c6-a743-4a30-9ceb-97845012759e" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-7e5b19c6-a743-4a30-9ceb-97845012759e" acquired by "delete_volume" :: waited 0.021s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1b96d-648f-4184-a6be-d08301260924]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:23 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:23 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:24 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.532s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:24 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 1G Apr 13 09:47:24 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:24 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.531s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:24 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e Apr 13 09:47:24 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:24 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 1G" returned: 0 in 0.564s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:24 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 Apr 13 09:47:24 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:24 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e5b19c6-a743-4a30-9ceb-97845012759e" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-7e5b19c6-a743-4a30-9ceb-97845012759e" released by "delete_volume" :: held 1.028s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Created reservations ['99ec7220-2282-4076-a616-f71c7d91e0b0', '0c92d6de-2c85-4c79-a7f0-9bb299cacc40', '33d52d1b-c3f7-4039-9941-648de7cbb7c9', 'fd837320-b4f0-4979-9c24-0ec317dcfee9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:25 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:25 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:25 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510" returned: 0 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:25 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 is being set with open permissions: ugo+rw Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:25 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 Apr 13 09:47:25 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:25 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.422s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Deleted volume successfully. Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-591cb03d-92a8-4d4a-a807-b51b57b47fab tempest-VolumeDependencyTests-310108007 None] Lock "cinder-7e5b19c6-a743-4a30-9ceb-97845012759e-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:25 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510" returned: 0 in 0.406s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-69c82b20-c94b-42ce-92b5-a812003c959f tempest-SnapshotsActionsTest-476340526 None] Create snapshot completed successfully Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-b855b98b-651f-4f3c-83a4-5281696d99fa-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-b855b98b-651f-4f3c-83a4-5281696d99fa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-b855b98b-651f-4f3c-83a4-5281696d99fa" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-b855b98b-651f-4f3c-83a4-5281696d99fa" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[41940055-2af2-42df-8e34-e9c6b804be96]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:26 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa Apr 13 09:47:26 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-866952bd-0c73-4097-b318-50d3ba9e4510-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-866952bd-0c73-4097-b318-50d3ba9e4510-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-866952bd-0c73-4097-b318-50d3ba9e4510" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-866952bd-0c73-4097-b318-50d3ba9e4510" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Deleting offline snapshot 866952bd-0c73-4097-b318-50d3ba9e4510 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] snapshot_file for this snap is: volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698d29e-c495-46cc-8636-b28c04dcc8da]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:26 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 Apr 13 09:47:26 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:26 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa" returned: 0 in 0.513s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:26 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa Apr 13 09:47:26 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:26 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510" returned: 0 in 0.498s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8ec24-bc36-402d-aaf4-8fe5a628bfa2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:26 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:26 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:27 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-b855b98b-651f-4f3c-83a4-5281696d99fa" returned: 0 in 0.418s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-b855b98b-651f-4f3c-83a4-5281696d99fa" released by "delete_volume" :: held 0.962s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Created reservations ['b51025d7-49f0-4a49-ab79-220cea94da22', 'fcdff7ec-ddfe-492a-baa8-51d68b0e074a', 'a4beec15-903e-41b8-ad0b-7e59d8a8eb13', '00929d7a-78cd-4474-82f9-c6a5b7384227'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:27 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:27 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-f38b4b58-bc27-4701-a926-05b39a700ba6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-f38b4b58-bc27-4701-a926-05b39a700ba6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "cinder-quobyte-f38b4b58-bc27-4701-a926-05b39a700ba6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-f38b4b58-bc27-4701-a926-05b39a700ba6" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe68cb-612f-4527-8806-3488bbc235b3]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:27 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.538s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:27 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 Apr 13 09:47:27 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:27 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 Apr 13 09:47:27 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:27 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.445s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Deleted volume successfully. Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-89f4fe05-5518-4d3c-8ef1-07efa886af84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-b855b98b-651f-4f3c-83a4-5281696d99fa-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:27 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6" returned: 0 in 0.508s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:27 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:27 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6 Apr 13 09:47:27 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:27 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510 Apr 13 09:47:27 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:28 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f38b4b58-bc27-4701-a926-05b39a700ba6" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:28 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.866952bd-0c73-4097-b318-50d3ba9e4510" returned: 0 in 0.419s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-quobyte-f38b4b58-bc27-4701-a926-05b39a700ba6" released by "delete_volume" :: held 0.982s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-866952bd-0c73-4097-b318-50d3ba9e4510" released by "_delete_snapshot" :: held 1.987s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" released by "delete_snapshot" :: held 2.005s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Created reservations ['198f4712-6229-485c-bae4-f833534e3e01', '43cd2d82-f4ae-4388-96af-fa956517d3d1', '3461552d-cb73-4b78-ad7a-a1efe9341f63', '357811bc-6c09-462c-8dec-2993dbcc2403'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Created reservations ['6a3990c5-ab47-4338-a8c4-80807b9410e3', '54afa51d-8876-4e0a-803d-c1f39c96bc36', '83c51ffd-50e9-4cca-b3a7-acfb5dca06f6', '4aa61d55-a64e-4fcf-8c5c-5c1fde5b72a7'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Delete snapshot completed successfully. Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e95ae057-01fe-4166-9ad7-6c6dfbec102b tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-866952bd-0c73-4097-b318-50d3ba9e4510-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:28 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:28 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:28 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.413s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Deleted volume successfully. Apr 13 09:47:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d7dd316c-430d-4ce0-8207-94b104192e84 tempest-VolumeDependencyTests-310108007 None] Lock "cinder-f38b4b58-bc27-4701-a926-05b39a700ba6-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Creating offline snapshot be6fcced-b562-468a-b452-5ae835599867 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:29 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[95942143-5f6b-45a1-92c5-5a72da46a62c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:29 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:29 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:30 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.556s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:30 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 1G Apr 13 09:47:30 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:30 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 1G" returned: 0 in 0.559s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:30 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 Apr 13 09:47:30 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:31 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867" returned: 0 in 0.511s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:31 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 is being set with open permissions: ugo+rw Apr 13 09:47:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:31 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 Apr 13 09:47:31 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:31 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867" returned: 0 in 0.503s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-eb9699ea-d6c4-4b76-a7a7-2fc8cf45d7e2 tempest-SnapshotsActionsTest-476340526 None] Create snapshot completed successfully Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-be6fcced-b562-468a-b452-5ae835599867-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-be6fcced-b562-468a-b452-5ae835599867-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-be6fcced-b562-468a-b452-5ae835599867" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-be6fcced-b562-468a-b452-5ae835599867" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Deleting offline snapshot be6fcced-b562-468a-b452-5ae835599867 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] snapshot_file for this snap is: volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5e91b-1f20-4be9-9d9c-aa3fdea83e99]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:32 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 Apr 13 09:47:32 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:33 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867" returned: 0 in 0.543s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eb06bc-1dd5-4275-93f5-ac553376f95f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:33 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:33 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:33 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.481s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:33 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 Apr 13 09:47:33 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:34 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867" returned: 0 in 0.624s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:34 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867 Apr 13 09:47:34 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:35 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.be6fcced-b562-468a-b452-5ae835599867" returned: 0 in 0.443s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-be6fcced-b562-468a-b452-5ae835599867" released by "_delete_snapshot" :: held 2.141s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" released by "delete_snapshot" :: held 2.154s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:35 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=173,cinder:INSERT=51,cinder:UPDATE=206,cinder:DELETE=10 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:47:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Created reservations ['000db7c5-7c86-46a3-a36d-df4a03a85b03', '0c099fd5-6c20-4041-82b9-0f31143ccdec', 'c0ff0c10-7497-47d5-8d4c-c79e8afc1cf4', '8fc78a3a-7dd0-40e1-83c6-ae74a548dae2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:35 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Delete snapshot completed successfully. Apr 13 09:47:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dd85b4e9-e553-4fcb-9a75-0dd27c87dec0 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-be6fcced-b562-468a-b452-5ae835599867-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=183,cinder:INSERT=68,cinder:UPDATE=217,cinder:DELETE=17 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Creating offline snapshot 79476821-7eb3-4b17-8eda-6b08454eead1 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b41b0e-6c51-48d8-a3e9-0415e294c0ed]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:36 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:36 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:36 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.513s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:36 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 1G Apr 13 09:47:36 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:37 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 1G" returned: 0 in 0.535s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:37 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 Apr 13 09:47:37 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:37 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1" returned: 0 in 0.482s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:37 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 is being set with open permissions: ugo+rw Apr 13 09:47:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:37 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 Apr 13 09:47:37 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:38 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1" returned: 0 in 0.459s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f699cdf6-196b-4c88-8bae-411dbe2e414a tempest-SnapshotsActionsTest-476340526 None] Create snapshot completed successfully Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-79476821-7eb3-4b17-8eda-6b08454eead1-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-79476821-7eb3-4b17-8eda-6b08454eead1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-79476821-7eb3-4b17-8eda-6b08454eead1" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-79476821-7eb3-4b17-8eda-6b08454eead1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Deleting offline snapshot 79476821-7eb3-4b17-8eda-6b08454eead1 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] snapshot_file for this snap is: volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[959bb8f6-1cfb-4d7c-a7a0-5cfc38935f51]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:39 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 Apr 13 09:47:39 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:40 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1" returned: 0 in 0.564s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57a6f95-a3fc-46f1-8816-c385e73c057b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:40 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:40 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:40 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.544s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:40 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 Apr 13 09:47:40 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:41 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1" returned: 0 in 0.534s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:41 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1 Apr 13 09:47:41 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:41 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.79476821-7eb3-4b17-8eda-6b08454eead1" returned: 0 in 0.490s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-79476821-7eb3-4b17-8eda-6b08454eead1" released by "_delete_snapshot" :: held 2.218s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" released by "delete_snapshot" :: held 2.233s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Created reservations ['c31ac150-167e-4cc2-9ce6-06266e6e621a', '1820dff4-a9c6-4745-9139-21b5fc9d501b', '3f09781a-0f73-4dae-9d7f-a54c12f85a1b', 'e34defcb-69c3-41e6-ab57-e3cda300c1d2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:41 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Delete snapshot completed successfully. Apr 13 09:47:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a8f4b272-5bae-4646-9c90-f2cc54dc4da6 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-79476821-7eb3-4b17-8eda-6b08454eead1-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:42 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Creating offline snapshot a53f4180-db0c-4cd6-8e45-8df02736f4aa of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:42 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e580c4-fd09-476f-abbb-32fdc6299ef1]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:42 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:42 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:43 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.642s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:43 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa 1G Apr 13 09:47:43 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:44 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa 1G" returned: 0 in 0.564s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:44 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa Apr 13 09:47:44 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:44 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa" returned: 0 in 0.627s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:44 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa is being set with open permissions: ugo+rw Apr 13 09:47:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:44 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa Apr 13 09:47:44 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:45 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:45 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f57cb6e4-752e-457c-ad68-abd6d57bdd46 tempest-SnapshotsActionsTest-476340526 None] Create snapshot completed successfully Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Flow 'volume_create_manager' (1cda10fe-ee58-4ab5-8e69-5ae38c3d908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b54d3a-8481-439c-819f-88a0135938de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b54d3a-8481-439c-819f-88a0135938de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1619345585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f197c9-60ac-40a9-8694-58b08e662c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebfa52ffb7d9479492e88d4b4189f509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:45Z,use_quota=True,user_id='001e9c8783914e519feeaca57a9003e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea90c287-f712-469a-921d-00a8f54e9fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea90c287-f712-469a-921d-00a8f54e9fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc49d090-331c-4ef2-ba89-fa8b71bf97c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc49d090-331c-4ef2-ba89-fa8b71bf97c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f197c9-60ac-40a9-8694-58b08e662c99', 'volume_name': 'volume-33f197c9-60ac-40a9-8694-58b08e662c99', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac328f4-4813-4cd2-892f-1667a0260a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac328f4-4813-4cd2-892f-1667a0260a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b197da-2b1a-409b-b56b-e8b3162a4acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:45 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Volume 33f197c9-60ac-40a9-8694-58b08e662c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f197c9-60ac-40a9-8694-58b08e662c99', 'volume_size': 1} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1619345585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f197c9-60ac-40a9-8694-58b08e662c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebfa52ffb7d9479492e88d4b4189f509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:45Z,use_quota=True,user_id='001e9c8783914e519feeaca57a9003e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Creating volume 33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:47:45 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:45 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 1073741824 Apr 13 09:47:45 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:45 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 1073741824" returned: 0 in 0.569s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:45 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:47:45 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-a53f4180-db0c-4cd6-8e45-8df02736f4aa-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-a53f4180-db0c-4cd6-8e45-8df02736f4aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Acquiring lock "cinder-quobyte-a53f4180-db0c-4cd6-8e45-8df02736f4aa" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-a53f4180-db0c-4cd6-8e45-8df02736f4aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Deleting offline snapshot a53f4180-db0c-4cd6-8e45-8df02736f4aa of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] snapshot_file for this snap is: volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b72d707-34ec-4e3c-85d2-62c1f08573a7]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:46 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa Apr 13 09:47:46 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:46 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b197da-2b1a-409b-b56b-e8b3162a4acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f197c9-60ac-40a9-8694-58b08e662c99', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519491ed-d1d3-4102-970f-cbe0126ed6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Volume volume-33f197c9-60ac-40a9-8694-58b08e662c99 (33f197c9-60ac-40a9-8694-58b08e662c99): created successfully Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519491ed-d1d3-4102-970f-cbe0126ed6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Flow 'volume_create_manager' (1cda10fe-ee58-4ab5-8e69-5ae38c3d908c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:46 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9dbb509b-92cc-4d81-b996-f781b980edf5 tempest-SnapshotDependencyTests-655633527 None] Created volume successfully. Apr 13 09:47:46 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa" returned: 0 in 0.518s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[75168ff3-99d2-458e-9958-fd80952e65f9]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:46 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:46 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:47 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.460s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:47 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa Apr 13 09:47:47 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:47 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Creating offline snapshot 25496ed7-8acf-4cad-adf7-39c15744e023 of volume 33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa" returned: 0 in 0.530s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76d87d0-be70-47b5-a12a-ad4ca0474592]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:47 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa Apr 13 09:47:47 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:47 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:47:47 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:48 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.a53f4180-db0c-4cd6-8e45-8df02736f4aa" returned: 0 in 0.439s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-a53f4180-db0c-4cd6-8e45-8df02736f4aa" released by "_delete_snapshot" :: held 2.000s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" released by "delete_snapshot" :: held 2.018s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Created reservations ['abbcb3ee-e334-44a6-9a64-5d5d50f9cd2c', '13970997-7445-4591-9883-5dd8be6cf61d', 'f3d1c82d-bec4-498b-8326-8fde63556017', 'c70c3d91-f8b6-4f4b-acd5-940e9ac3d982'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:48 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Delete snapshot completed successfully. Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.537s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0633f044-d7ee-4c74-8e3d-6183bccf5be8 tempest-SnapshotsActionsTest-230498486 None] Lock "cinder-a53f4180-db0c-4cd6-8e45-8df02736f4aa-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:48 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 1G Apr 13 09:47:48 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:48 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 1G" returned: 0 in 0.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f197c9-60ac-40a9-8694-58b08e662c99 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:48 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f197c9-60ac-40a9-8694-58b08e662c99 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 Apr 13 09:47:48 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:49 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f197c9-60ac-40a9-8694-58b08e662c99 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023" returned: 0 in 0.468s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:49 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 is being set with open permissions: ugo+rw Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:49 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 Apr 13 09:47:49 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "cinder-9a881c6a-36c3-4110-a9e7-5c9357ac5c53-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-9a881c6a-36c3-4110-a9e7-5c9357ac5c53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "cinder-quobyte-9a881c6a-36c3-4110-a9e7-5c9357ac5c53" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-quobyte-9a881c6a-36c3-4110-a9e7-5c9357ac5c53" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Deleting offline snapshot 9a881c6a-36c3-4110-a9e7-5c9357ac5c53 of volume 694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] snapshot_file for this snap is: volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a2d7ec-0a69-4479-8cdc-8e52fea916e6]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:49 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:49 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:49 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:49 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info Apr 13 09:47:49 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:50 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a471ed89-fd69-4668-94df-22046e0cd2e9]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:50 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info" returned: 0 in 0.432s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:50 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info is being set with open permissions: ugo+rw Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:50 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info Apr 13 09:47:50 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:50 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd Apr 13 09:47:50 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:50 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:50 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" returned: 0 in 0.478s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.info" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:50 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:50 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.971s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fe2e00f0-97de-4664-97cc-df2931f16f2e tempest-SnapshotDependencyTests-655633527 None] Create snapshot completed successfully Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Flow 'volume_create_manager' (c2e80469-fced-4776-bb7c-c8ddac399c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3167a598-fbab-4b82-8004-c023807315d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3167a598-fbab-4b82-8004-c023807315d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962d5466-18f8-4153-bdf5-4426465376a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebfa52ffb7d9479492e88d4b4189f509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25496ed7-8acf-4cad-adf7-39c15744e023,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:47:51Z,use_quota=True,user_id='001e9c8783914e519feeaca57a9003e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9646a78c-c486-46bb-b251-945ab85c295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:51 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9646a78c-c486-46bb-b251-945ab85c295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834fee9b-6972-4560-92df-a7623b38a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834fee9b-6972-4560-92df-a7623b38a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '962d5466-18f8-4153-bdf5-4426465376a3', 'volume_name': 'volume-962d5466-18f8-4153-bdf5-4426465376a3', 'volume_size': 1, 'snapshot_id': '25496ed7-8acf-4cad-adf7-39c15744e023'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0534ec0-c10d-4125-9110-3bc0bde2cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0534ec0-c10d-4125-9110-3bc0bde2cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa28b3d-174b-4f10-922d-d774df64d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Volume 962d5466-18f8-4153-bdf5-4426465376a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-962d5466-18f8-4153-bdf5-4426465376a3', 'volume_size': 1, 'snapshot_id': '25496ed7-8acf-4cad-adf7-39c15744e023'} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.537s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-quobyte-25496ed7-8acf-4cad-adf7-39c15744e023-962d5466-18f8-4153-bdf5-4426465376a3" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:51 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53 Apr 13 09:47:51 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-25496ed7-8acf-4cad-adf7-39c15744e023-962d5466-18f8-4153-bdf5-4426465376a3" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Creating volume 962d5466-18f8-4153-bdf5-4426465376a3 from snapshot 25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-quobyte-962d5466-18f8-4153-bdf5-4426465376a3" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-962d5466-18f8-4153-bdf5-4426465376a3" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] snapshot: 25496ed7-8acf-4cad-adf7-39c15744e023, volume: 962d5466-18f8-4153-bdf5-4426465376a3, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7acb963-afbc-43f1-bc09-90627afe810f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:51 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 Apr 13 09:47:51 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:51 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd.9a881c6a-36c3-4110-a9e7-5c9357ac5c53" returned: 0 in 0.439s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-quobyte-9a881c6a-36c3-4110-a9e7-5c9357ac5c53" released by "_delete_snapshot" :: held 2.005s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" released by "delete_snapshot" :: held 2.024s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Created reservations ['e32b5287-1f8c-4d33-89cb-d32dcb7c71d0', 'fa0caa1e-1ab8-40b1-a214-46c3ca85035a', '9acaa376-5a89-4bff-88ad-b981f58151ab', '14399a47-bff4-4b4f-bd88-11b5dc2853f6'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:51 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Delete snapshot completed successfully. Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9527ff06-aa2b-442c-86e5-1165b46cd279 tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-9a881c6a-36c3-4110-a9e7-5c9357ac5c53-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:51 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023" returned: 0 in 0.550s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33f197c9-60ac-40a9-8694-58b08e662c99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef7981f-fdc2-4451-96bd-0fab677c5990]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:51 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:47:51 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:52 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:52 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 Apr 13 09:47:52 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "cinder-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af592f-608f-43de-8eb5-180e4989f7a8]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:53 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd Apr 13 09:47:53 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:54 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" returned: 0 in 1.105s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:54 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd Apr 13 09:47:54 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:54 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3" returned: 0 in 2.178s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d0ba3-b0b0-4c25-a429-5dc8fb92730b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:54 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:47:54 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:54 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" returned: 0 in 0.467s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-quobyte-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd" released by "delete_volume" :: held 1.623s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Created reservations ['cce33af4-200e-4f53-9239-8137e239cf19', 'ff9b0bd2-bea5-48ae-86ad-feb03314f1b7', '40696406-68df-4397-99d2-8ea40fde769f', '4cdcf10b-e2d4-4296-953b-b1ecaf300f85'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:54 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:47:54 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:55 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.602s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:47:55 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Converted 1024.00 MB image at 469.77 MB/s Apr 13 09:47:55 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 is being set with open permissions: ugo+rw Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:55 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 Apr 13 09:47:55 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:55 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.443s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:47:55 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Deleted volume successfully. Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-47d62c22-a98a-495f-b8c6-d4e91d59b18d tempest-SnapshotsActionsTest-476340526 None] Lock "cinder-694f4c1c-b81a-4c12-bf77-c6eb6327dfdd-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:55 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-962d5466-18f8-4153-bdf5-4426465376a3" released by "_copy_volume_from_snapshot" :: held 4.307s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-25496ed7-8acf-4cad-adf7-39c15744e023-962d5466-18f8-4153-bdf5-4426465376a3" released by "_create_volume_from_snapshot" :: held 4.326s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.337s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa28b3d-174b-4f10-922d-d774df64d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962d5466-18f8-4153-bdf5-4426465376a3', 'volume_size': 1, 'snapshot_id': '25496ed7-8acf-4cad-adf7-39c15744e023'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b708ae95-a354-4e3d-b2f2-7a38758c0a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:47:55 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Volume volume-962d5466-18f8-4153-bdf5-4426465376a3 (962d5466-18f8-4153-bdf5-4426465376a3): created successfully Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b708ae95-a354-4e3d-b2f2-7a38758c0a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:47:55 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Flow 'volume_create_manager' (c2e80469-fced-4776-bb7c-c8ddac399c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:47:55 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-3811a04a-c929-404b-9069-26f891ddcc01 tempest-SnapshotDependencyTests-655633527 None] Created volume successfully. Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-25496ed7-8acf-4cad-adf7-39c15744e023-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-25496ed7-8acf-4cad-adf7-39c15744e023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-quobyte-33f197c9-60ac-40a9-8694-58b08e662c99" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-33f197c9-60ac-40a9-8694-58b08e662c99" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-quobyte-25496ed7-8acf-4cad-adf7-39c15744e023" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-25496ed7-8acf-4cad-adf7-39c15744e023" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Deleting offline snapshot 25496ed7-8acf-4cad-adf7-39c15744e023 of volume 33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] snapshot_file for this snap is: volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf18af-9e5f-455b-b86e-79e692cd0502]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:56 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 Apr 13 09:47:56 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:57 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023" returned: 0 in 0.494s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33f197c9-60ac-40a9-8694-58b08e662c99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:47:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0355193-0dff-4d00-824f-60095927c744]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:57 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:47:57 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:57 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.505s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:57 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 Apr 13 09:47:57 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:58 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023" returned: 0 in 0.545s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:58 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023 Apr 13 09:47:58 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:47:58 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99.25496ed7-8acf-4cad-adf7-39c15744e023" returned: 0 in 0.416s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-25496ed7-8acf-4cad-adf7-39c15744e023" released by "_delete_snapshot" :: held 2.023s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-33f197c9-60ac-40a9-8694-58b08e662c99" released by "delete_snapshot" :: held 2.039s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Created reservations ['53a25c52-18a3-4078-bbb8-4ba10c428009', '2b59a4e0-d53d-419a-b9dd-0ad22bb7609c', 'f1b31d8a-a2df-47e0-9f9a-d4a12a0e1a90', 'b67aeb64-fa6c-4502-8a89-8693c6f3f6e9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:47:58 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Delete snapshot completed successfully. Apr 13 09:47:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-089ce32e-24c8-4229-8ff9-55f8cfbc9453 tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-25496ed7-8acf-4cad-adf7-39c15744e023-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:47:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-33f197c9-60ac-40a9-8694-58b08e662c99-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-33f197c9-60ac-40a9-8694-58b08e662c99-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-quobyte-33f197c9-60ac-40a9-8694-58b08e662c99" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:47:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-33f197c9-60ac-40a9-8694-58b08e662c99" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:47:59 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea66fc68-428e-45e2-88de-b8959561a292]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:47:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:47:59 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:47:59 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:00 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:00 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99 Apr 13 09:48:00 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:00 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:00 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:00 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-33f197c9-60ac-40a9-8694-58b08e662c99" returned: 0 in 0.428s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-33f197c9-60ac-40a9-8694-58b08e662c99" released by "delete_volume" :: held 0.945s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Created reservations ['6eaf00d8-0d09-4458-9140-57bada1021f1', 'e3d58036-1a76-4636-850d-605f4597862b', 'e355e92b-0dab-4c06-b4f4-2c5df64746c3', 'be50cb01-3183-4ea4-87ca-0e4d0f1b7215'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:00 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:00 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-962d5466-18f8-4153-bdf5-4426465376a3-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-962d5466-18f8-4153-bdf5-4426465376a3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "cinder-quobyte-962d5466-18f8-4153-bdf5-4426465376a3" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-962d5466-18f8-4153-bdf5-4426465376a3" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dae0f5-6be5-4701-bc63-bb247eea9028]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:00 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.464s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:00 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 Apr 13 09:48:00 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:01 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.545s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Deleted volume successfully. Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b51103f-e62b-446d-9a10-b753b77896ae tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-33f197c9-60ac-40a9-8694-58b08e662c99-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:01 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3" returned: 0 in 0.555s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:01 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3 Apr 13 09:48:01 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:01 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-962d5466-18f8-4153-bdf5-4426465376a3" returned: 0 in 0.467s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-quobyte-962d5466-18f8-4153-bdf5-4426465376a3" released by "delete_volume" :: held 1.050s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:01 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Created reservations ['22de003d-d666-41b4-930f-bb0da06a88c0', '1d2bde8a-bc6c-495d-b3e7-5e42d2fc74bf', '0dfcd910-1acd-432b-a80c-36713355a3ef', '4f59f341-b113-4364-a8bf-bd4a6abcf5aa'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:02 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:02 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:02 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.476s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:02 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Deleted volume successfully. Apr 13 09:48:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-53c2a3d3-5780-4bc5-b215-78ee4311e3de tempest-SnapshotDependencyTests-655633527 None] Lock "cinder-962d5466-18f8-4153-bdf5-4426465376a3-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Flow 'volume_create_manager' (2657ccc5-9a2d-45c1-b556-2a77925ddfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6ce42f-aad2-4a5b-92b7-9b0734e8860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6ce42f-aad2-4a5b-92b7-9b0734e8860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1307060907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d575e74a-b2bf-4d02-9427-6da6e993ef93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a09796e9e854d99aa937c2fee67ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:08Z,use_quota=True,user_id='86852e15d59a410099ec4d8fc2a815e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404141a4-6880-4998-9e6d-9eeabd8af154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404141a4-6880-4998-9e6d-9eeabd8af154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61918a5f-e00d-439c-a243-c3838d4e8501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61918a5f-e00d-439c-a243-c3838d4e8501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd575e74a-b2bf-4d02-9427-6da6e993ef93', 'volume_name': 'volume-d575e74a-b2bf-4d02-9427-6da6e993ef93', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7fc440-05b3-4173-b402-c1e63c5fe804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7fc440-05b3-4173-b402-c1e63c5fe804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fdd5d5-c5e9-4d72-962f-b72affcffaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:07 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Volume d575e74a-b2bf-4d02-9427-6da6e993ef93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d575e74a-b2bf-4d02-9427-6da6e993ef93', 'volume_size': 1} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1307060907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d575e74a-b2bf-4d02-9427-6da6e993ef93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a09796e9e854d99aa937c2fee67ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:08Z,use_quota=True,user_id='86852e15d59a410099ec4d8fc2a815e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Creating volume d575e74a-b2bf-4d02-9427-6da6e993ef93 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:07 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:07 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 1073741824 Apr 13 09:48:07 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:08 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 1073741824" returned: 0 in 0.566s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:08 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 Apr 13 09:48:08 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:08 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93" returned: 0 in 0.531s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fdd5d5-c5e9-4d72-962f-b72affcffaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d575e74a-b2bf-4d02-9427-6da6e993ef93', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f06695-533f-415e-b925-21890d81fda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:09 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Volume volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 (d575e74a-b2bf-4d02-9427-6da6e993ef93): created successfully Apr 13 09:48:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f06695-533f-415e-b925-21890d81fda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:09 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Flow 'volume_create_manager' (2657ccc5-9a2d-45c1-b556-2a77925ddfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2a55c1b1-36a2-42a7-8639-b6f3017e7140 tempest-VolumesListAdminTestJSON-728931519 None] Created volume successfully. Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Flow 'volume_create_manager' (5271113f-ec8e-4412-ac3a-c8fea654d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03f272e-3711-4a04-a344-728e48a792c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03f272e-3711-4a04-a344-728e48a792c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-656886295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cbafc9-63e7-4b63-9cf8-928cf28f9d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a09796e9e854d99aa937c2fee67ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:10Z,use_quota=True,user_id='86852e15d59a410099ec4d8fc2a815e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5a4f66-ba45-494d-a9cc-337e9b8f3ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5a4f66-ba45-494d-a9cc-337e9b8f3ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdd95d1-55a1-4b6f-9df0-08e0d89c26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdd95d1-55a1-4b6f-9df0-08e0d89c26b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2cbafc9-63e7-4b63-9cf8-928cf28f9d17', 'volume_name': 'volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f932a1db-30c6-4d10-976b-41b6aef32b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f932a1db-30c6-4d10-976b-41b6aef32b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f57132-4889-4653-bca3-1ab2c03cd4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:10 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Volume d2cbafc9-63e7-4b63-9cf8-928cf28f9d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17', 'volume_size': 1} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-656886295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2cbafc9-63e7-4b63-9cf8-928cf28f9d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a09796e9e854d99aa937c2fee67ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:10Z,use_quota=True,user_id='86852e15d59a410099ec4d8fc2a815e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Creating volume d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:10 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:10 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 1073741824 Apr 13 09:48:10 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:10 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 1073741824" returned: 0 in 0.478s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:10 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 Apr 13 09:48:10 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:11 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17" returned: 0 in 0.424s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f57132-4889-4653-bca3-1ab2c03cd4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20c58ed-1335-443d-9cec-77047c29fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:11 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Volume volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 (d2cbafc9-63e7-4b63-9cf8-928cf28f9d17): created successfully Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20c58ed-1335-443d-9cec-77047c29fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Flow 'volume_create_manager' (5271113f-ec8e-4412-ac3a-c8fea654d067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:11 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0daab426-3710-4e5c-bfcf-77311acc6d7e tempest-VolumesListAdminTestJSON-728931519 None] Created volume successfully. Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Flow 'volume_create_manager' (3adf96a6-34be-48bc-8ae7-a0ca69e8c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd323a15-d83f-4eb4-81a2-6484ae0164e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd323a15-d83f-4eb4-81a2-6484ae0164e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-181480131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee8cbee-5d30-47ca-a9b7-b40946836a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a09796e9e854d99aa937c2fee67ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:13Z,use_quota=True,user_id='86852e15d59a410099ec4d8fc2a815e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf9d66a-fec1-46a7-99cf-3c8cf2d2e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf9d66a-fec1-46a7-99cf-3c8cf2d2e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260f926b-6c49-43de-a816-d170b66947f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260f926b-6c49-43de-a816-d170b66947f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee8cbee-5d30-47ca-a9b7-b40946836a9c', 'volume_name': 'volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80936816-97a8-408e-bdd1-c3a80e453f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80936816-97a8-408e-bdd1-c3a80e453f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a303f329-b2f2-47f2-96bd-f83c91ba172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:12 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Volume fee8cbee-5d30-47ca-a9b7-b40946836a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c', 'volume_size': 1} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-181480131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee8cbee-5d30-47ca-a9b7-b40946836a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a09796e9e854d99aa937c2fee67ab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:13Z,use_quota=True,user_id='86852e15d59a410099ec4d8fc2a815e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Creating volume fee8cbee-5d30-47ca-a9b7-b40946836a9c {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:12 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:12 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c 1073741824 Apr 13 09:48:12 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:13 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c 1073741824" returned: 0 in 0.485s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:13 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c Apr 13 09:48:13 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:13 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c" returned: 0 in 0.408s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a303f329-b2f2-47f2-96bd-f83c91ba172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b19f163-f228-4efe-81b3-e52fd8ca791e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:13 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Volume volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c (fee8cbee-5d30-47ca-a9b7-b40946836a9c): created successfully Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b19f163-f228-4efe-81b3-e52fd8ca791e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:13 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Flow 'volume_create_manager' (3adf96a6-34be-48bc-8ae7-a0ca69e8c507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:13 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8f6973b5-a456-4bc3-bfa0-917f61241029 tempest-VolumesListAdminTestJSON-728931519 None] Created volume successfully. Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Flow 'volume_create_manager' (338f40dd-8450-4ef5-ab57-3142e2d4527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5544e151-1fe5-4c3b-b087-5dde84df4bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5544e151-1fe5-4c3b-b087-5dde84df4bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f969e135-d384-4929-91c1-0d4d9989f3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da748773c25f41159120bab9c2477580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:15Z,use_quota=True,user_id='7dcbbc71a9dc4a1283474739958a547e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d69eda-0fa8-42fc-b031-60f00dea5416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d69eda-0fa8-42fc-b031-60f00dea5416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750bf6ca-baa0-4bc5-9bec-b55282a274a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750bf6ca-baa0-4bc5-9bec-b55282a274a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f969e135-d384-4929-91c1-0d4d9989f3f1', 'volume_name': 'volume-f969e135-d384-4929-91c1-0d4d9989f3f1', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79513847-71d9-4981-96ce-8b1ca99bd717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79513847-71d9-4981-96ce-8b1ca99bd717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba17cb8-c366-4972-8510-b8dfac4b6c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:15 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Volume f969e135-d384-4929-91c1-0d4d9989f3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f969e135-d384-4929-91c1-0d4d9989f3f1', 'volume_size': 1} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f969e135-d384-4929-91c1-0d4d9989f3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da748773c25f41159120bab9c2477580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:15Z,use_quota=True,user_id='7dcbbc71a9dc4a1283474739958a547e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Creating volume f969e135-d384-4929-91c1-0d4d9989f3f1 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:15 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:15 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 1073741824 Apr 13 09:48:15 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:15 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 1073741824" returned: 0 in 0.472s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:15 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 Apr 13 09:48:15 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:16 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1" returned: 0 in 0.398s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba17cb8-c366-4972-8510-b8dfac4b6c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f969e135-d384-4929-91c1-0d4d9989f3f1', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bc44ca-0470-43d2-83b8-c3718bf440b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Volume volume-f969e135-d384-4929-91c1-0d4d9989f3f1 (f969e135-d384-4929-91c1-0d4d9989f3f1): created successfully Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bc44ca-0470-43d2-83b8-c3718bf440b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Flow 'volume_create_manager' (338f40dd-8450-4ef5-ab57-3142e2d4527a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:16 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2df5994d-96ad-4c82-a0de-c639217b62f1 tempest-VolumesListAdminTestJSON-732004322 None] Created volume successfully. Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Acquiring lock "cinder-f969e135-d384-4929-91c1-0d4d9989f3f1-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Lock "cinder-f969e135-d384-4929-91c1-0d4d9989f3f1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Acquiring lock "cinder-quobyte-f969e135-d384-4929-91c1-0d4d9989f3f1" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Lock "cinder-quobyte-f969e135-d384-4929-91c1-0d4d9989f3f1" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9cc7c5-52d7-4ccf-a1da-1938029f4e95]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "cinder-fee8cbee-5d30-47ca-a9b7-b40946836a9c-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-fee8cbee-5d30-47ca-a9b7-b40946836a9c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:16 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 Apr 13 09:48:16 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "cinder-quobyte-fee8cbee-5d30-47ca-a9b7-b40946836a9c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-quobyte-fee8cbee-5d30-47ca-a9b7-b40946836a9c" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68c52ef-c2bb-458c-9390-d218d4a06f28]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:16 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c Apr 13 09:48:16 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:16 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1" returned: 0 in 0.489s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:16 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1 Apr 13 09:48:16 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:16 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c" returned: 0 in 0.470s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:17 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c Apr 13 09:48:17 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:17 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f969e135-d384-4929-91c1-0d4d9989f3f1" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Lock "cinder-quobyte-f969e135-d384-4929-91c1-0d4d9989f3f1" released by "delete_volume" :: held 0.951s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Created reservations ['b0ac7eb3-68e8-480f-88e3-100481634820', '344ed6fd-843b-4442-88f0-7ac05c452b92', '3f6a6aa6-08af-45c5-abef-7b53a603cf67', '4e2a91fc-9764-45e6-97d0-a9f55bd972d8'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:17 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-fee8cbee-5d30-47ca-a9b7-b40946836a9c" returned: 0 in 0.437s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-quobyte-fee8cbee-5d30-47ca-a9b7-b40946836a9c" released by "delete_volume" :: held 0.943s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:17 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:17 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Created reservations ['29690b8d-06dd-4521-bcb7-03387b9cb963', '9d1188ee-1765-4de6-9a7b-3b6ebe4380d1', 'd6e5553b-7e13-4f9c-b11d-e43f14debc33', '0791e72f-02dc-466b-a633-89a2995f069b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:17 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:17 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "cinder-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "cinder-quobyte-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-quobyte-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f740e967-e1a1-43bb-8e3d-b2548b098635]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:17 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 Apr 13 09:48:17 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:17 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:17 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Deleted volume successfully. Apr 13 09:48:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-32599996-3b63-4d04-a723-e2725ca54444 tempest-VolumesListAdminTestJSON-732004322 None] Lock "cinder-f969e135-d384-4929-91c1-0d4d9989f3f1-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:18 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.453s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Deleted volume successfully. Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-79bc38ce-8826-43e1-9970-697ab75c4788 tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-fee8cbee-5d30-47ca-a9b7-b40946836a9c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:18 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:18 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17 Apr 13 09:48:18 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:18 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17" returned: 0 in 0.387s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-quobyte-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17" released by "delete_volume" :: held 0.903s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Created reservations ['1ceef21e-3dbe-4b12-a9c1-b178f8d9822f', 'a4daa88e-ad2d-4e77-a1e3-9d72968b027c', '303a18a8-5621-47dc-b8dd-43bfcc48e3bf', 'fc6ee82a-354f-446f-8ccf-0b67ea6e4dd2'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:18 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:18 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "cinder-d575e74a-b2bf-4d02-9427-6da6e993ef93-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-d575e74a-b2bf-4d02-9427-6da6e993ef93-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "cinder-quobyte-d575e74a-b2bf-4d02-9427-6da6e993ef93" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-quobyte-d575e74a-b2bf-4d02-9427-6da6e993ef93" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b8321-7533-4b3f-9e5f-738fc8f9cdac]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:18 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 Apr 13 09:48:18 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:19 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.449s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:19 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Deleted volume successfully. Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7b0dbb8d-ec4e-4c8f-bd99-72420b231b7e tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-d2cbafc9-63e7-4b63-9cf8-928cf28f9d17-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:19 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93" returned: 0 in 0.531s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:19 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93 Apr 13 09:48:19 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:19 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d575e74a-b2bf-4d02-9427-6da6e993ef93" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-quobyte-d575e74a-b2bf-4d02-9427-6da6e993ef93" released by "delete_volume" :: held 1.026s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Created reservations ['5c8ea0ce-4227-468f-954f-c91d901b8cc6', 'b00831a4-5434-4087-b036-933b5183c26c', '64f74d04-9e69-410a-9983-4940e870fc57', '615bd114-d6ce-4980-8cc9-4c12196a1ed9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:19 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:19 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:20 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.411s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:20 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:20 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Deleted volume successfully. Apr 13 09:48:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-2ed1d4d3-1339-49de-abec-cb905a2ef98d tempest-VolumesListAdminTestJSON-728931519 None] Lock "cinder-d575e74a-b2bf-4d02-9427-6da6e993ef93-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Flow 'volume_create_manager' (dfa6cae8-9d24-4def-8372-ee6ea6ad0797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bbcfe7-8e0c-427b-9482-5469f22fa14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bbcfe7-8e0c-427b-9482-5469f22fa14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1099088501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ffe6c-94eb-48f6-b89c-551ee474efb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed1eedcef7d7474ebe8c7a45b4355426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:25Z,use_quota=True,user_id='6d23e44ef1234593ba32eb35325ea783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b2802a-ab0d-4dd8-9240-abf73c58c060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b2802a-ab0d-4dd8-9240-abf73c58c060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c60dc55-3abb-4639-a743-e3473fb6de00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c60dc55-3abb-4639-a743-e3473fb6de00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611ffe6c-94eb-48f6-b89c-551ee474efb6', 'volume_name': 'volume-611ffe6c-94eb-48f6-b89c-551ee474efb6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04606dde-d7c9-4ae4-b265-c2f2028293c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04606dde-d7c9-4ae4-b265-c2f2028293c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8d5040-597f-4d00-90f6-9cf13f4a8f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:24 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Volume 611ffe6c-94eb-48f6-b89c-551ee474efb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611ffe6c-94eb-48f6-b89c-551ee474efb6', 'volume_size': 1} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1099088501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611ffe6c-94eb-48f6-b89c-551ee474efb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed1eedcef7d7474ebe8c7a45b4355426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:25Z,use_quota=True,user_id='6d23e44ef1234593ba32eb35325ea783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Creating volume 611ffe6c-94eb-48f6-b89c-551ee474efb6 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:24 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:24 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 1073741824 Apr 13 09:48:24 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:25 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 1073741824" returned: 0 in 0.549s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:25 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 Apr 13 09:48:25 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:25 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6" returned: 0 in 0.419s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8d5040-597f-4d00-90f6-9cf13f4a8f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611ffe6c-94eb-48f6-b89c-551ee474efb6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4bcb5a-945f-4979-9267-ebb793b1c191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:25 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Volume volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 (611ffe6c-94eb-48f6-b89c-551ee474efb6): created successfully Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4bcb5a-945f-4979-9267-ebb793b1c191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:25 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Flow 'volume_create_manager' (dfa6cae8-9d24-4def-8372-ee6ea6ad0797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1c785c1e-cb71-40a5-94c8-c226b7f5917f tempest-VolumesListTestJSON-1343505372 None] Created volume successfully. Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Flow 'volume_create_manager' (9371673d-6a00-49c9-ae4a-70c8b06c3cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f5530b-d3e5-4fbe-8abb-f98dc731708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f5530b-d3e5-4fbe-8abb-f98dc731708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1028485273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87631a89-54e2-4acd-8308-dcfb86998e2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed1eedcef7d7474ebe8c7a45b4355426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:27Z,use_quota=True,user_id='6d23e44ef1234593ba32eb35325ea783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc4990b-7c67-4111-af85-94141ce6f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc4990b-7c67-4111-af85-94141ce6f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e73689-c5e9-4a75-be4f-bdce8482e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e73689-c5e9-4a75-be4f-bdce8482e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87631a89-54e2-4acd-8308-dcfb86998e2f', 'volume_name': 'volume-87631a89-54e2-4acd-8308-dcfb86998e2f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef8c39-d904-4135-ab66-0df383a46249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef8c39-d904-4135-ab66-0df383a46249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32e493e-f754-44a9-be83-0368aec09918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Volume 87631a89-54e2-4acd-8308-dcfb86998e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87631a89-54e2-4acd-8308-dcfb86998e2f', 'volume_size': 1} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1028485273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87631a89-54e2-4acd-8308-dcfb86998e2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed1eedcef7d7474ebe8c7a45b4355426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:27Z,use_quota=True,user_id='6d23e44ef1234593ba32eb35325ea783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Creating volume 87631a89-54e2-4acd-8308-dcfb86998e2f {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:27 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:27 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f 1073741824 Apr 13 09:48:27 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:27 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f 1073741824" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:27 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f Apr 13 09:48:27 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:28 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f" returned: 0 in 0.417s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32e493e-f754-44a9-be83-0368aec09918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87631a89-54e2-4acd-8308-dcfb86998e2f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9581e6-bad7-4949-8d9e-c4bc3da013ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:28 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Volume volume-87631a89-54e2-4acd-8308-dcfb86998e2f (87631a89-54e2-4acd-8308-dcfb86998e2f): created successfully Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9581e6-bad7-4949-8d9e-c4bc3da013ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Flow 'volume_create_manager' (9371673d-6a00-49c9-ae4a-70c8b06c3cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7a356fb6-b1d9-41c7-84c6-be48ad70a82e tempest-VolumesListTestJSON-1343505372 None] Created volume successfully. Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Flow 'volume_create_manager' (2a7674c7-683b-4544-a467-34125bde8c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e52d8c-65a1-40c7-8c76-d84b00fa87dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e52d8c-65a1-40c7-8c76-d84b00fa87dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-746633618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d34e1d-5044-4afc-bfb3-de8af2d027b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed1eedcef7d7474ebe8c7a45b4355426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:29Z,use_quota=True,user_id='6d23e44ef1234593ba32eb35325ea783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8df63d6-1791-45c6-8fbe-cef63bd0b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8df63d6-1791-45c6-8fbe-cef63bd0b93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa8ab4b-0928-48d7-b591-6422791a8798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa8ab4b-0928-48d7-b591-6422791a8798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d34e1d-5044-4afc-bfb3-de8af2d027b2', 'volume_name': 'volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1987bc9-e94e-400d-8d97-2657bbc4b459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1987bc9-e94e-400d-8d97-2657bbc4b459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b93618-a742-4ea5-a531-8eaec15391a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:29 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Volume 28d34e1d-5044-4afc-bfb3-de8af2d027b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2', 'volume_size': 1} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-746633618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d34e1d-5044-4afc-bfb3-de8af2d027b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed1eedcef7d7474ebe8c7a45b4355426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:29Z,use_quota=True,user_id='6d23e44ef1234593ba32eb35325ea783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Creating volume 28d34e1d-5044-4afc-bfb3-de8af2d027b2 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:29 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:29 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 1073741824 Apr 13 09:48:29 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:30 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 1073741824" returned: 0 in 0.474s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:30 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 Apr 13 09:48:30 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:30 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2" returned: 0 in 0.381s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b93618-a742-4ea5-a531-8eaec15391a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbeab93d-616b-4582-aa96-6138d98b7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:30 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Volume volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 (28d34e1d-5044-4afc-bfb3-de8af2d027b2): created successfully Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbeab93d-616b-4582-aa96-6138d98b7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Flow 'volume_create_manager' (2a7674c7-683b-4544-a467-34125bde8c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-883440f5-fa32-4830-952a-54cdda0c9ba7 tempest-VolumesListTestJSON-1343505372 None] Created volume successfully. Apr 13 09:48:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "cinder-28d34e1d-5044-4afc-bfb3-de8af2d027b2-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-28d34e1d-5044-4afc-bfb3-de8af2d027b2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "cinder-quobyte-28d34e1d-5044-4afc-bfb3-de8af2d027b2" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-quobyte-28d34e1d-5044-4afc-bfb3-de8af2d027b2" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3510c033-eee2-402e-9a3f-0a21da9c904b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:32 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 Apr 13 09:48:32 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:33 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2" returned: 0 in 0.462s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:33 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2 Apr 13 09:48:33 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:33 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-28d34e1d-5044-4afc-bfb3-de8af2d027b2" returned: 0 in 0.400s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-quobyte-28d34e1d-5044-4afc-bfb3-de8af2d027b2" released by "delete_volume" :: held 0.892s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Created reservations ['2a527aa9-b623-45ad-9680-30c02bd4021e', 'fb0936e1-b072-47d6-9ac9-785ce5538896', '3f96ae52-233f-4f09-bdfa-68dd43b20a92', 'd109c2bf-aa1a-4e62-bcf5-b7b27f99877b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:33 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:33 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "cinder-87631a89-54e2-4acd-8308-dcfb86998e2f-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-87631a89-54e2-4acd-8308-dcfb86998e2f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "cinder-quobyte-87631a89-54e2-4acd-8308-dcfb86998e2f" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-quobyte-87631a89-54e2-4acd-8308-dcfb86998e2f" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[1843da0b-1ab2-4a36-ad74-be2711d29415]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:33 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f Apr 13 09:48:33 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:33 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Deleted volume successfully. Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6d2cad1c-d9c0-4417-8efa-c2d45e0f610a tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-28d34e1d-5044-4afc-bfb3-de8af2d027b2-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:34 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f" returned: 0 in 0.475s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:34 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f Apr 13 09:48:34 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:34 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-87631a89-54e2-4acd-8308-dcfb86998e2f" returned: 0 in 0.427s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-quobyte-87631a89-54e2-4acd-8308-dcfb86998e2f" released by "delete_volume" :: held 0.923s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Created reservations ['de69893d-31f7-4ce2-923f-74a4001fbf64', 'c1a1cc56-f670-4a63-a8db-6821fac3ed33', 'f36ae222-4aa0-4dff-a838-76150b772252', '32b00d3c-4bc7-40f5-8e9b-8bc328c60cad'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:34 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:34 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "cinder-611ffe6c-94eb-48f6-b89c-551ee474efb6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-611ffe6c-94eb-48f6-b89c-551ee474efb6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "cinder-quobyte-611ffe6c-94eb-48f6-b89c-551ee474efb6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-quobyte-611ffe6c-94eb-48f6-b89c-551ee474efb6" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a31ef2-f039-4a2a-8d99-efc801fda4f9]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:34 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 Apr 13 09:48:34 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:35 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.458s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:35 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Deleted volume successfully. Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:INSERT=35,cinder:UPDATE=142,cinder:SELECT=98,cinder:DELETE=10 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-408319c3-7d66-4bdc-aa8d-627c95c324e1 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-87631a89-54e2-4acd-8308-dcfb86998e2f-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:35 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6" returned: 0 in 0.466s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:35 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6 Apr 13 09:48:35 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:35 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-611ffe6c-94eb-48f6-b89c-551ee474efb6" returned: 0 in 0.387s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-quobyte-611ffe6c-94eb-48f6-b89c-551ee474efb6" released by "delete_volume" :: held 0.876s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Created reservations ['eef77790-5c97-4f42-b267-b7994eb6737e', '14671293-5c04-4506-ae08-165cca2a2fb9', '845ffba0-aa94-4e77-adbd-42ebf9c4b8ca', '0a822cdc-978e-478a-967a-0848dfd54424'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:35 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:48:35 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:36 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.464s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:36 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:48:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Deleted volume successfully. Apr 13 09:48:36 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=95,cinder:UPDATE=118,cinder:DELETE=12,cinder:INSERT=31 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:48:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1d7f96d5-6255-42a8-8def-f76c633f8885 tempest-VolumesListTestJSON-1343505372 None] Lock "cinder-611ffe6c-94eb-48f6-b89c-551ee474efb6-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (e36887a8-86ab-479f-a65c-689e43008428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b70962-acc9-4da4-bc1b-f1c98515d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b70962-acc9-4da4-bc1b-f1c98515d59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1531062798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9f21d0-b7df-49e9-b88f-cf6094b493e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:44Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1e5f8e-818c-4ff3-b178-e2807de5b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1e5f8e-818c-4ff3-b178-e2807de5b674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e81b6b-8f75-4323-9af9-d2102b40c659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e81b6b-8f75-4323-9af9-d2102b40c659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9f21d0-b7df-49e9-b88f-cf6094b493e6', 'volume_name': 'volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c225fc-5d90-45bc-b7b2-c215c0e9b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c225fc-5d90-45bc-b7b2-c215c0e9b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482c846b-83aa-48fc-97b2-06181a9f6a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:43 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume db9f21d0-b7df-49e9-b88f-cf6094b493e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6', 'volume_size': 1} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1531062798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9f21d0-b7df-49e9-b88f-cf6094b493e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:44Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating volume db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:43 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:43 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 1073741824 Apr 13 09:48:43 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:44 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 1073741824" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:44 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 Apr 13 09:48:44 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:44 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6" returned: 0 in 0.448s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482c846b-83aa-48fc-97b2-06181a9f6a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47565a36-9dc8-4e9c-82a8-d0a3b8cc1793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:44 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 (db9f21d0-b7df-49e9-b88f-cf6094b493e6): created successfully Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47565a36-9dc8-4e9c-82a8-d0a3b8cc1793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:44 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (e36887a8-86ab-479f-a65c-689e43008428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:44 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ae70aee4-1130-4c52-b758-01cac12347c6 tempest-VolumesSnapshotTestJSON-1216026779 None] Created volume successfully. Apr 13 09:48:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating offline snapshot 2791fd83-bd6e-4672-87df-d0f3b1b6cd44 of volume db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:48:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf493eb6-94d4-4566-967f-a9ec23b817cc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:46 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 Apr 13 09:48:46 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:46 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6" returned: 0 in 0.462s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:46 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 1G Apr 13 09:48:46 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:46 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 1G" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:46 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 Apr 13 09:48:46 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:47 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44" returned: 0 in 0.399s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:47 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 is being set with open permissions: ugo+rw Apr 13 09:48:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:47 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 Apr 13 09:48:47 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:47 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44" returned: 0 in 0.405s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:47 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info Apr 13 09:48:47 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:48 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info" returned: 0 in 0.428s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:48 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info is being set with open permissions: ugo+rw Apr 13 09:48:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:48 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info Apr 13 09:48:48 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:48 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.info" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a918ee45-3b70-4de4-9c32-2126c68e71a8 tempest-VolumesSnapshotTestJSON-1216026779 None] Create snapshot completed successfully Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-2791fd83-bd6e-4672-87df-d0f3b1b6cd44-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-2791fd83-bd6e-4672-87df-d0f3b1b6cd44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-db9f21d0-b7df-49e9-b88f-cf6094b493e6" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-db9f21d0-b7df-49e9-b88f-cf6094b493e6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-2791fd83-bd6e-4672-87df-d0f3b1b6cd44" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-2791fd83-bd6e-4672-87df-d0f3b1b6cd44" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Deleting offline snapshot 2791fd83-bd6e-4672-87df-d0f3b1b6cd44 of volume db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] snapshot_file for this snap is: volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[34baff57-1366-4eea-acaf-ba04a9ba72f4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:49 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 Apr 13 09:48:49 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:49 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44" returned: 0 in 0.481s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d1dcfa-2059-4a7c-b128-0d8c0e037e13]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:49 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 Apr 13 09:48:49 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:50 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6" returned: 0 in 0.489s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:50 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 Apr 13 09:48:50 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:50 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:50 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44 Apr 13 09:48:50 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:51 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6.2791fd83-bd6e-4672-87df-d0f3b1b6cd44" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-2791fd83-bd6e-4672-87df-d0f3b1b6cd44" released by "_delete_snapshot" :: held 1.896s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-db9f21d0-b7df-49e9-b88f-cf6094b493e6" released by "delete_snapshot" :: held 1.907s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['ac6c69c3-a6e1-402c-8e3d-b0f174664eb5', '06824472-530b-4d9f-b056-85044f745de0', 'cb66db07-7f87-4f98-82c5-778e3fac4358', '03c2e14a-92f6-4b1e-9342-3b2345b5b702'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:48:51 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Delete snapshot completed successfully. Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e1310da9-6e9e-415a-a604-877efdbb040c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-2791fd83-bd6e-4672-87df-d0f3b1b6cd44-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (98e1d202-6e90-4030-9663-bf5bcadd2059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a5bcf-c5f4-4ee5-9448-e9e0b5eab4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a5bcf-c5f4-4ee5-9448-e9e0b5eab4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1030283564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb1d9af-b343-4835-88d5-c06d6fae9768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:52Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f2c48e-5ecd-4367-942d-f6e9f56c2806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f2c48e-5ecd-4367-942d-f6e9f56c2806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c939e7-d38f-44d9-a685-7f72f70c9ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c939e7-d38f-44d9-a685-7f72f70c9ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb1d9af-b343-4835-88d5-c06d6fae9768', 'volume_name': 'volume-7eb1d9af-b343-4835-88d5-c06d6fae9768', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0067b523-fa36-490b-aa9b-9003ec6c0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0067b523-fa36-490b-aa9b-9003ec6c0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82526cea-a188-452d-b8f1-62d9f3062ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Volume 7eb1d9af-b343-4835-88d5-c06d6fae9768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb1d9af-b343-4835-88d5-c06d6fae9768', 'volume_size': 1} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1030283564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb1d9af-b343-4835-88d5-c06d6fae9768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:52Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Creating volume 7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:51 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:48:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:51 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 1073741824 Apr 13 09:48:51 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:52 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 1073741824" returned: 0 in 0.484s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:52 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:48:52 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:52 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.400s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82526cea-a188-452d-b8f1-62d9f3062ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb1d9af-b343-4835-88d5-c06d6fae9768', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285ee786-9e33-439d-ac02-da4705fcbef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:52 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Volume volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 (7eb1d9af-b343-4835-88d5-c06d6fae9768): created successfully Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285ee786-9e33-439d-ac02-da4705fcbef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (98e1d202-6e90-4030-9663-bf5bcadd2059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:52 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-92558f0f-bfff-4a56-9459-800400d2c95e tempest-VolumesSnapshotTestJSON-1216026779 None] Created volume successfully. Apr 13 09:48:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating offline snapshot 66978a7a-7b9e-4620-a5a6-5f306ef5dd1d of volume 7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:48:53 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28b6e8b-ac47-46c3-8eae-90abcd6a360f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:53 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:48:53 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:54 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:54 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d 1G Apr 13 09:48:54 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:54 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d 1G" returned: 0 in 0.467s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:54 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d Apr 13 09:48:54 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:55 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:55 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d is being set with open permissions: ugo+rw Apr 13 09:48:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:55 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d Apr 13 09:48:55 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:55 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" returned: 0 in 0.399s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:55 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info Apr 13 09:48:55 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:56 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info" returned: 0 in 0.414s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:56 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info is being set with open permissions: ugo+rw Apr 13 09:48:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:56 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info Apr 13 09:48:56 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:56 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.info" returned: 0 in 0.392s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:56 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-43c3e69f-c759-43e1-8bcc-d900bf723fd3 tempest-VolumesSnapshotTestJSON-1216026779 None] Create snapshot completed successfully Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (41a328a3-535f-465f-a3b1-6cace65e29b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac57687-708a-47d6-8b20-53a84000a50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac57687-708a-47d6-8b20-53a84000a50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2068339695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f7ce88-f878-45f3-91da-cb289a1be4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:48:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=66978a7a-7b9e-4620-a5a6-5f306ef5dd1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:48:57Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c3b4ca-9591-42c8-afb6-7bd9559d048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c3b4ca-9591-42c8-afb6-7bd9559d048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab915600-e195-4f93-9687-21364ba426be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab915600-e195-4f93-9687-21364ba426be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60f7ce88-f878-45f3-91da-cb289a1be4c1', 'volume_name': 'volume-60f7ce88-f878-45f3-91da-cb289a1be4c1', 'volume_size': 2, 'snapshot_id': '66978a7a-7b9e-4620-a5a6-5f306ef5dd1d'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb62668d-53c4-4582-8e4a-ea9ef24df73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb62668d-53c4-4582-8e4a-ea9ef24df73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cab366-5c0a-413a-89cf-b3a853c1b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:48:57 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume 60f7ce88-f878-45f3-91da-cb289a1be4c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60f7ce88-f878-45f3-91da-cb289a1be4c1', 'volume_size': 2, 'snapshot_id': '66978a7a-7b9e-4620-a5a6-5f306ef5dd1d'} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d-60f7ce88-f878-45f3-91da-cb289a1be4c1" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d-60f7ce88-f878-45f3-91da-cb289a1be4c1" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating volume 60f7ce88-f878-45f3-91da-cb289a1be4c1 from snapshot 66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-60f7ce88-f878-45f3-91da-cb289a1be4c1" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-60f7ce88-f878-45f3-91da-cb289a1be4c1" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] snapshot: 66978a7a-7b9e-4620-a5a6-5f306ef5dd1d, volume: 60f7ce88-f878-45f3-91da-cb289a1be4c1, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f41ad6-fbf9-4b5f-b97f-4a2d6b13f516]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:57 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d Apr 13 09:48:57 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:57 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" returned: 0 in 0.452s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb1d9af-b343-4835-88d5-c06d6fae9768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1086d7-a2d6-4826-ade5-b0c7d2a92380]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:48:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:57 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:48:57 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:48:58 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 13 09:48:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.459s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:48:58 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:48:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:48:58 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 Apr 13 09:48:58 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:00 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1" returned: 0 in 1.845s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c121c0-5f83-4b69-9b13-c1308967fd2c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:00 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:49:00 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:00 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:00 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:00 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.602s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:49:00 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Converted 1024.00 MB image at 554.76 MB/s Apr 13 09:49:00 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 is being set with open permissions: ugo+rw Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:00 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 Apr 13 09:49:00 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:00 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.404s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:01 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1" returned: 0 in 0.392s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-60f7ce88-f878-45f3-91da-cb289a1be4c1" released by "_copy_volume_from_snapshot" :: held 3.801s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d-60f7ce88-f878-45f3-91da-cb289a1be4c1" released by "_create_volume_from_snapshot" :: held 3.815s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.821s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cab366-5c0a-413a-89cf-b3a853c1b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f7ce88-f878-45f3-91da-cb289a1be4c1', 'volume_size': 2, 'snapshot_id': '66978a7a-7b9e-4620-a5a6-5f306ef5dd1d'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b9e9d2-b140-4195-9151-3e72ad79e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:01 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 (60f7ce88-f878-45f3-91da-cb289a1be4c1): created successfully Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b9e9d2-b140-4195-9151-3e72ad79e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (41a328a3-535f-465f-a3b1-6cace65e29b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0a526495-cb94-4bbc-a964-224d7c588ac7 tempest-VolumesSnapshotTestJSON-1216026779 None] Created volume successfully. Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-60f7ce88-f878-45f3-91da-cb289a1be4c1-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-60f7ce88-f878-45f3-91da-cb289a1be4c1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-60f7ce88-f878-45f3-91da-cb289a1be4c1" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-60f7ce88-f878-45f3-91da-cb289a1be4c1" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed56f7c-64eb-4cc4-8332-81a1c6e1ee41]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:01 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 Apr 13 09:49:01 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:01 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1" returned: 0 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:02 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1 Apr 13 09:49:02 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:02 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-60f7ce88-f878-45f3-91da-cb289a1be4c1" returned: 0 in 0.400s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-60f7ce88-f878-45f3-91da-cb289a1be4c1" released by "delete_volume" :: held 0.905s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['36ead21d-50f6-42f0-90dd-8fc760c25625', 'a4b63457-e345-4ef7-b804-5219986e7f23', '888cb556-1446-4c60-be60-31aa2a2cfdd5', '95847cfa-1bae-4800-9c6c-34384a0593cd'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:02 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:02 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-7eb1d9af-b343-4835-88d5-c06d6fae9768" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-7eb1d9af-b343-4835-88d5-c06d6fae9768" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Deleting offline snapshot 66978a7a-7b9e-4620-a5a6-5f306ef5dd1d of volume 7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] snapshot_file for this snap is: volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3ea7f9-d762-4b19-b791-24284893bec1]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:02 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d Apr 13 09:49:02 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:02 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:02 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Deleted volume successfully. Apr 13 09:49:02 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-34564542-9381-4ccb-bddd-47a99c2725f4 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-60f7ce88-f878-45f3-91da-cb289a1be4c1-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:03 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" returned: 0 in 0.486s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb1d9af-b343-4835-88d5-c06d6fae9768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:49:03 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bf267a-347f-482c-aecb-d5a46c32806d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:03 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:49:03 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:03 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.520s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:03 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d Apr 13 09:49:03 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:04 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" returned: 0 in 0.454s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:04 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d Apr 13 09:49:04 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:04 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768.66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" returned: 0 in 0.443s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d" released by "_delete_snapshot" :: held 1.961s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-7eb1d9af-b343-4835-88d5-c06d6fae9768" released by "delete_snapshot" :: held 1.976s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['042ad897-df63-450f-98ec-0fec1330ff2e', 'b09ad8d1-9af1-46f5-b9cf-99fb90d16089', 'e4697d5e-66b6-4df4-ada4-f12957f7370c', '589641d9-aff8-4baf-9f1b-0a5c111a900f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Delete snapshot completed successfully. Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-aeb03690-ff20-4656-b654-ef10605519c1 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-66978a7a-7b9e-4620-a5a6-5f306ef5dd1d-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-7eb1d9af-b343-4835-88d5-c06d6fae9768-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-7eb1d9af-b343-4835-88d5-c06d6fae9768-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-7eb1d9af-b343-4835-88d5-c06d6fae9768" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-7eb1d9af-b343-4835-88d5-c06d6fae9768" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eedbbd0-00f2-4f76-ac78-b72daf8a7ca0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:04 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:49:04 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:05 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:05 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768 Apr 13 09:49:05 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:05 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7eb1d9af-b343-4835-88d5-c06d6fae9768" returned: 0 in 0.390s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-7eb1d9af-b343-4835-88d5-c06d6fae9768" released by "delete_volume" :: held 0.890s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['6b473b44-7768-4dba-88bb-2ae759ae2a9b', '4c6d8d56-17a0-4eec-9087-86f50e1e8456', 'b0b74bc8-c435-462b-b8a5-8ead7458d011', 'b0fa45fa-7e59-4c91-a58c-304da2bb8b3c'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:05 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:05 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (7e6c36f3-cb6a-4f99-9225-bd4cafc18a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfdad76-f0ec-4bf1-bc81-dfd6217d90d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfdad76-f0ec-4bf1-bc81-dfd6217d90d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422910607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a6d0e3-dc76-430a-a101-8542548b6f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:06Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33e055c-c993-4138-b613-d692acf67aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33e055c-c993-4138-b613-d692acf67aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:06 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6850c3ce-057a-4827-9a83-d8e2a766ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6850c3ce-057a-4827-9a83-d8e2a766ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a6d0e3-dc76-430a-a101-8542548b6f0d', 'volume_name': 'volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb859c1-6adb-484d-adab-54a753b00d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb859c1-6adb-484d-adab-54a753b00d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c9385d-1224-4438-ba7e-11f358472d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:06 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Volume a5a6d0e3-dc76-430a-a101-8542548b6f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d', 'volume_size': 1} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422910607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a6d0e3-dc76-430a-a101-8542548b6f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:06Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Creating volume a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:06 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:06 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Deleted volume successfully. Apr 13 09:49:06 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d 1073741824 Apr 13 09:49:06 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-bb569777-2426-46c1-aabb-b53f7973b593 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-7eb1d9af-b343-4835-88d5-c06d6fae9768-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:06 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d 1073741824" returned: 0 in 0.529s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:06 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:06 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:07 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.542s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c9385d-1224-4438-ba7e-11f358472d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d1523-7dc9-46de-8d9f-6b864fac4373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:07 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Volume volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d (a5a6d0e3-dc76-430a-a101-8542548b6f0d): created successfully Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d1523-7dc9-46de-8d9f-6b864fac4373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (7e6c36f3-cb6a-4f99-9225-bd4cafc18a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-aed82e47-ce7a-479d-854a-9b94f592b44a tempest-VolumesSnapshotTestJSON-1216026779 None] Created volume successfully. Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating offline snapshot 59f284ef-817d-4df8-b8bd-332ac3163bf6 of volume a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7674e331-6c81-4c93-a969-187d218cbb3f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:08 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:08 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:08 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.476s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:08 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 1G Apr 13 09:49:08 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:09 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 1G" returned: 0 in 0.540s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:09 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 Apr 13 09:49:09 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:09 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6" returned: 0 in 0.436s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:09 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 is being set with open permissions: ugo+rw Apr 13 09:49:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:09 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 Apr 13 09:49:09 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:10 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6" returned: 0 in 0.391s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:10 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info Apr 13 09:49:10 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:10 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info" returned: 0 in 0.432s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:10 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info is being set with open permissions: ugo+rw Apr 13 09:49:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:10 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info Apr 13 09:49:10 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:11 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.info" returned: 0 in 0.415s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:11 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7c3199d7-fd0f-46c0-ba1b-1d279263f860 tempest-VolumesSnapshotTestJSON-1216026779 None] Create snapshot completed successfully Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (13cbbd2a-69f9-4e11-bb80-1cafb4fc4492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7493aa-e355-480c-9548-1eaed730ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7493aa-e355-480c-9548-1eaed730ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2076456749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae03bb07-02a8-4e2c-a31a-15efc942048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5539b5f8c7ed4e568c89288086de0988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59f284ef-817d-4df8-b8bd-332ac3163bf6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:12Z,use_quota=True,user_id='0dfe41e0670948158dbae7f5c45b598d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8d5038-3cca-4da7-bae5-d0b1045a8348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8d5038-3cca-4da7-bae5-d0b1045a8348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67467c16-c812-4d2c-b529-52397a7a9ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67467c16-c812-4d2c-b529-52397a7a9ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae03bb07-02a8-4e2c-a31a-15efc942048d', 'volume_name': 'volume-ae03bb07-02a8-4e2c-a31a-15efc942048d', 'volume_size': 1, 'snapshot_id': '59f284ef-817d-4df8-b8bd-332ac3163bf6'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba36998-8263-4531-b36f-4040c3c1638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba36998-8263-4531-b36f-4040c3c1638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da6f323-b18f-4b8b-a5ad-4f758218c553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:11 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume ae03bb07-02a8-4e2c-a31a-15efc942048d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae03bb07-02a8-4e2c-a31a-15efc942048d', 'volume_size': 1, 'snapshot_id': '59f284ef-817d-4df8-b8bd-332ac3163bf6'} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-59f284ef-817d-4df8-b8bd-332ac3163bf6-ae03bb07-02a8-4e2c-a31a-15efc942048d" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-59f284ef-817d-4df8-b8bd-332ac3163bf6-ae03bb07-02a8-4e2c-a31a-15efc942048d" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating volume ae03bb07-02a8-4e2c-a31a-15efc942048d from snapshot 59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-ae03bb07-02a8-4e2c-a31a-15efc942048d" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-ae03bb07-02a8-4e2c-a31a-15efc942048d" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] snapshot: 59f284ef-817d-4df8-b8bd-332ac3163bf6, volume: ae03bb07-02a8-4e2c-a31a-15efc942048d, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[6370630f-c5c6-418e-8013-1ffa86a0c8e4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:12 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 Apr 13 09:49:12 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:12 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6" returned: 0 in 0.440s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d3f71f-70ad-4e32-8fcd-224c11942e86]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:12 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:12 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:12 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.482s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:49:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:12 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d Apr 13 09:49:12 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:14 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d" returned: 0 in 1.848s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:14 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c7faf-4185-47b9-bed4-37e18c8effbe]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:14 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:14 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:15 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.574s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:49:15 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Converted 1024.00 MB image at 553.71 MB/s Apr 13 09:49:15 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d is being set with open permissions: ugo+rw Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:15 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d Apr 13 09:49:15 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:15 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d" returned: 0 in 0.379s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-ae03bb07-02a8-4e2c-a31a-15efc942048d" released by "_copy_volume_from_snapshot" :: held 3.787s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-59f284ef-817d-4df8-b8bd-332ac3163bf6-ae03bb07-02a8-4e2c-a31a-15efc942048d" released by "_create_volume_from_snapshot" :: held 3.802s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.811s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da6f323-b18f-4b8b-a5ad-4f758218c553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae03bb07-02a8-4e2c-a31a-15efc942048d', 'volume_size': 1, 'snapshot_id': '59f284ef-817d-4df8-b8bd-332ac3163bf6'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde9390d-d63b-450b-9544-eb9944da3c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:15 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Volume volume-ae03bb07-02a8-4e2c-a31a-15efc942048d (ae03bb07-02a8-4e2c-a31a-15efc942048d): created successfully Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde9390d-d63b-450b-9544-eb9944da3c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:15 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Flow 'volume_create_manager' (13cbbd2a-69f9-4e11-bb80-1cafb4fc4492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:15 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ca60f8c3-be8e-404c-861f-0cd99c29df10 tempest-VolumesSnapshotTestJSON-1216026779 None] Created volume successfully. Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-ae03bb07-02a8-4e2c-a31a-15efc942048d-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-ae03bb07-02a8-4e2c-a31a-15efc942048d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-ae03bb07-02a8-4e2c-a31a-15efc942048d" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-ae03bb07-02a8-4e2c-a31a-15efc942048d" acquired by "delete_volume" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e90b3d-601f-4ff4-9441-b3209bbb5058]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:16 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d Apr 13 09:49:16 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:16 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d" returned: 0 in 0.462s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:16 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d Apr 13 09:49:16 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:17 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ae03bb07-02a8-4e2c-a31a-15efc942048d" returned: 0 in 0.407s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-ae03bb07-02a8-4e2c-a31a-15efc942048d" released by "delete_volume" :: held 0.896s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['7d8e44ce-5b8b-451e-b130-12cd67604e2c', '19743fa2-7c45-4438-be1f-0ac64a1f7e98', '1350a880-fc2e-45a4-b518-bba031955f2a', '5f73dc0d-7a70-4a03-99e1-bfaff578ef5f'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:17 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:17 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-59f284ef-817d-4df8-b8bd-332ac3163bf6-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-59f284ef-817d-4df8-b8bd-332ac3163bf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-a5a6d0e3-dc76-430a-a101-8542548b6f0d" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-a5a6d0e3-dc76-430a-a101-8542548b6f0d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-59f284ef-817d-4df8-b8bd-332ac3163bf6" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-59f284ef-817d-4df8-b8bd-332ac3163bf6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Deleting offline snapshot 59f284ef-817d-4df8-b8bd-332ac3163bf6 of volume a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] snapshot_file for this snap is: volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c15811-fbbf-40a9-a3a1-bf0fc0bb26c3]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:17 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 Apr 13 09:49:17 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:17 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.469s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:17 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Deleted volume successfully. Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0517ca66-2569-4ad2-8c76-c9206950d670 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-ae03bb07-02a8-4e2c-a31a-15efc942048d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:17 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6" returned: 0 in 0.514s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f503601-4b54-4e91-8d43-52176ae5a95d]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:17 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:17 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:18 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:18 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 Apr 13 09:49:18 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:18 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6" returned: 0 in 0.442s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:18 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6 Apr 13 09:49:18 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:19 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d.59f284ef-817d-4df8-b8bd-332ac3163bf6" returned: 0 in 0.409s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-59f284ef-817d-4df8-b8bd-332ac3163bf6" released by "_delete_snapshot" :: held 1.912s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-a5a6d0e3-dc76-430a-a101-8542548b6f0d" released by "delete_snapshot" :: held 1.925s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['8f11d0b0-b2cb-47ae-9df9-a62b179de66a', '9a9eabdd-c8ec-4042-bf27-064e92147000', 'd67dfab4-fa83-41ef-b462-7ae970485e96', '80dd555c-9040-4964-91de-52b914c499ee'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:19 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Delete snapshot completed successfully. Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-babaa3e4-c8da-427f-b2fb-8d19e89ca83c tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-59f284ef-817d-4df8-b8bd-332ac3163bf6-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-a5a6d0e3-dc76-430a-a101-8542548b6f0d-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-a5a6d0e3-dc76-430a-a101-8542548b6f0d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-a5a6d0e3-dc76-430a-a101-8542548b6f0d" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-a5a6d0e3-dc76-430a-a101-8542548b6f0d" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e71bc-320b-430b-8427-f7a8ce5947bc]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:19 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:19 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:20 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.494s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:20 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d Apr 13 09:49:20 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:20 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a5a6d0e3-dc76-430a-a101-8542548b6f0d" returned: 0 in 0.398s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-a5a6d0e3-dc76-430a-a101-8542548b6f0d" released by "delete_volume" :: held 0.931s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['7442adc7-904d-4256-ac25-a93c16185953', '4793107e-7d37-4fbf-9ea5-f613b72c43d7', 'f59fa30f-231d-42e1-9798-f318b8105fb7', '558e82a2-fdcc-4540-8aed-e35f68a6ec9c'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:20 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:20 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-db9f21d0-b7df-49e9-b88f-cf6094b493e6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-db9f21d0-b7df-49e9-b88f-cf6094b493e6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "cinder-quobyte-db9f21d0-b7df-49e9-b88f-cf6094b493e6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-db9f21d0-b7df-49e9-b88f-cf6094b493e6" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1fdb55-7daa-4678-af27-813d7d8f9e21]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:20 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 Apr 13 09:49:20 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:20 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:20 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:21 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Deleted volume successfully. Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-54862db9-0ba5-4c27-9809-86bf205ff3b3 tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-a5a6d0e3-dc76-430a-a101-8542548b6f0d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:21 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6" returned: 0 in 0.490s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:21 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6 Apr 13 09:49:21 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:21 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-db9f21d0-b7df-49e9-b88f-cf6094b493e6" returned: 0 in 0.435s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-quobyte-db9f21d0-b7df-49e9-b88f-cf6094b493e6" released by "delete_volume" :: held 0.960s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Created reservations ['6563c365-8881-4b61-94f8-4ab2b90b51bd', '04350cac-b784-4bfb-9bed-4237e4854b91', '59cd4a6d-d4ed-4a66-bb0e-e040a6da6cd8', '67d2c4ba-2139-4895-ae74-eb900913ed7b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:21 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:21 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:22 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.405s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:22 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Deleted volume successfully. Apr 13 09:49:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-af6a229e-ca91-45ee-a389-8b72e146bc4e tempest-VolumesSnapshotTestJSON-1216026779 None] Lock "cinder-db9f21d0-b7df-49e9-b88f-cf6094b493e6-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (78b5e949-2b5b-4964-a449-196ecf159239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badc500e-fc5f-47ef-8616-70ca9dcabcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badc500e-fc5f-47ef-8616-70ca9dcabcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240118189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e10193-3df9-4e70-9090-8da580f088a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370f100e-c8ed-4aeb-a44e-c2a9693a1285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370f100e-c8ed-4aeb-a44e-c2a9693a1285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dddbe60-e8b7-4216-a1bf-ff405f7438d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dddbe60-e8b7-4216-a1bf-ff405f7438d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e10193-3df9-4e70-9090-8da580f088a3', 'volume_name': 'volume-02e10193-3df9-4e70-9090-8da580f088a3', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aeb12f7-3cca-46a6-bf2f-904975edf525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aeb12f7-3cca-46a6-bf2f-904975edf525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d994c368-97c5-4eb7-b283-a4561c26dadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Volume 02e10193-3df9-4e70-9090-8da580f088a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e10193-3df9-4e70-9090-8da580f088a3', 'volume_size': 1} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240118189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e10193-3df9-4e70-9090-8da580f088a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Creating volume 02e10193-3df9-4e70-9090-8da580f088a3 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:26 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:26 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 1073741824 Apr 13 09:49:26 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (aec90b45-ad18-4e45-b92b-923ad68c8bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e35161-c94a-4a83-9d5a-9804abd2415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e35161-c94a-4a83-9d5a-9804abd2415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305714349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c1796d-fe61-46df-aa9a-09f677856041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fb06ef-8287-4ac8-9af0-c0f506ca7383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fb06ef-8287-4ac8-9af0-c0f506ca7383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e0761b-2e2e-4ca2-8a8a-f785309f808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e0761b-2e2e-4ca2-8a8a-f785309f808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6c1796d-fe61-46df-aa9a-09f677856041', 'volume_name': 'volume-d6c1796d-fe61-46df-aa9a-09f677856041', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5417d8-669d-46b1-9e99-022591f1c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5417d8-669d-46b1-9e99-022591f1c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66021e0-7d8e-41fe-9204-44d734a97a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Volume d6c1796d-fe61-46df-aa9a-09f677856041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6c1796d-fe61-46df-aa9a-09f677856041', 'volume_size': 1} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (e62838fa-2233-4c25-8faf-54fc2feb79e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69305169-ff0f-4411-841a-0a334029ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69305169-ff0f-4411-841a-0a334029ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273218448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb08c5d-75d0-4c01-a64e-f492812c3c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28501056-10bb-4560-80a6-1e646fa46e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28501056-10bb-4560-80a6-1e646fa46e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740eff3d-7cb1-492f-af21-110486e4d913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740eff3d-7cb1-492f-af21-110486e4d913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb08c5d-75d0-4c01-a64e-f492812c3c5c', 'volume_name': 'volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c95bd6-e0de-484e-a6ef-b6879af94e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c95bd6-e0de-484e-a6ef-b6879af94e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f23a33-5010-4777-8708-8f54a93deee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Volume edb08c5d-75d0-4c01-a64e-f492812c3c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c', 'volume_size': 1} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (4afc9a34-7554-4839-8dea-1037db5c305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3031474-3faa-4d63-bc28-ac68dd8ae62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3031474-3faa-4d63-bc28-ac68dd8ae62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095107991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3dc47e-7268-4ea7-b5d9-2db466143393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee90c398-d1ef-4aed-9b80-b0ad50a8ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee90c398-d1ef-4aed-9b80-b0ad50a8ab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22323ffb-76b8-4d15-819a-624a53c1f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22323ffb-76b8-4d15-819a-624a53c1f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3dc47e-7268-4ea7-b5d9-2db466143393', 'volume_name': 'volume-0d3dc47e-7268-4ea7-b5d9-2db466143393', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0c5aa4-a5cb-4d0c-95a5-f03d8e4f1ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0c5aa4-a5cb-4d0c-95a5-f03d8e4f1ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a782a8f3-f2a0-4c1b-98af-02ca23d47897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Volume 0d3dc47e-7268-4ea7-b5d9-2db466143393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3dc47e-7268-4ea7-b5d9-2db466143393', 'volume_size': 1} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 1073741824" returned: 0 in 0.662s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:27 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 Apr 13 09:49:27 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (8184b825-fa6f-4f43-b9a4-f7bbe9033190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd47cb5-d9e5-44e1-80d9-d46a1ec972f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd47cb5-d9e5-44e1-80d9-d46a1ec972f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1646820506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab748502-4198-4007-9ef4-abcd341e966c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:28Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65785e2-17c4-4fbb-8b96-5fd864eae0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65785e2-17c4-4fbb-8b96-5fd864eae0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa95b2bb-0d2d-4970-958d-99c7e2e858c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa95b2bb-0d2d-4970-958d-99c7e2e858c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab748502-4198-4007-9ef4-abcd341e966c', 'volume_name': 'volume-ab748502-4198-4007-9ef4-abcd341e966c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c90ff-0bc6-47d4-a496-14da6b1ece12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401c90ff-0bc6-47d4-a496-14da6b1ece12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdc53b0-8641-4384-a050-6717bda18a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Volume ab748502-4198-4007-9ef4-abcd341e966c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab748502-4198-4007-9ef4-abcd341e966c', 'volume_size': 1} Apr 13 09:49:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:28 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1305714349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c1796d-fe61-46df-aa9a-09f677856041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Creating volume d6c1796d-fe61-46df-aa9a-09f677856041 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:28 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d994c368-97c5-4eb7-b283-a4561c26dadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e10193-3df9-4e70-9090-8da580f088a3', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32369cc-7a7d-4a1e-a540-12cb9234bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:28 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 1073741824 Apr 13 09:49:28 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:28 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Volume volume-02e10193-3df9-4e70-9090-8da580f088a3 (02e10193-3df9-4e70-9090-8da580f088a3): created successfully Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32369cc-7a7d-4a1e-a540-12cb9234bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (78b5e949-2b5b-4964-a449-196ecf159239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-815ed4e9-94e1-48df-9cda-9f0f96359067 tempest-CreateVolumesFromImageTest-790055636 None] Created volume successfully. Apr 13 09:49:28 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 1073741824" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:28 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 Apr 13 09:49:28 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:28 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041" returned: 0 in 0.425s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1273218448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb08c5d-75d0-4c01-a64e-f492812c3c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Creating volume edb08c5d-75d0-4c01-a64e-f492812c3c5c {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:29 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66021e0-7d8e-41fe-9204-44d734a97a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c1796d-fe61-46df-aa9a-09f677856041', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7887a8e5-fdd6-4b57-a011-dd3b817d9b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:29 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c 1073741824 Apr 13 09:49:29 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:29 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Volume volume-d6c1796d-fe61-46df-aa9a-09f677856041 (d6c1796d-fe61-46df-aa9a-09f677856041): created successfully Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7887a8e5-fdd6-4b57-a011-dd3b817d9b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (aec90b45-ad18-4e45-b92b-923ad68c8bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:29 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-62f66766-fd43-4b29-8496-ce2fd08cdbcc tempest-CreateVolumesFromImageTest-790055636 None] Created volume successfully. Apr 13 09:49:29 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c 1073741824" returned: 0 in 0.531s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:29 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c Apr 13 09:49:29 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:29 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c" returned: 0 in 0.425s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.464s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095107991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3dc47e-7268-4ea7-b5d9-2db466143393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:27Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Creating volume 0d3dc47e-7268-4ea7-b5d9-2db466143393 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:29 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:30 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f23a33-5010-4777-8708-8f54a93deee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b241ea7-b215-4a88-a718-510187cb61b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:30 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 1073741824 Apr 13 09:49:30 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:30 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Volume volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c (edb08c5d-75d0-4c01-a64e-f492812c3c5c): created successfully Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b241ea7-b215-4a88-a718-510187cb61b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (e62838fa-2233-4c25-8faf-54fc2feb79e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:30 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a495953f-6add-4183-83a5-46f69d62dd19 tempest-CreateVolumesFromImageTest-790055636 None] Created volume successfully. Apr 13 09:49:30 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 1073741824" returned: 0 in 0.663s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:30 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:30 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 Apr 13 09:49:30 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:31 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393" returned: 0 in 0.426s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.307s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1646820506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab748502-4198-4007-9ef4-abcd341e966c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be2cb6828c47b39a36bac675f9be55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:28Z,use_quota=True,user_id='07e576661db9482cab955f9b2b18cd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Creating volume ab748502-4198-4007-9ef4-abcd341e966c {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:31 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a782a8f3-f2a0-4c1b-98af-02ca23d47897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3dc47e-7268-4ea7-b5d9-2db466143393', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:31 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c 1073741824 Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02cbdb1-3935-40d5-80af-9df9544b0ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:31 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:31 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Volume volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 (0d3dc47e-7268-4ea7-b5d9-2db466143393): created successfully Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02cbdb1-3935-40d5-80af-9df9544b0ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (4afc9a34-7554-4839-8dea-1037db5c305a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:31 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bdc29747-80bb-45a6-b152-d181b325031d tempest-CreateVolumesFromImageTest-790055636 None] Created volume successfully. Apr 13 09:49:31 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c 1073741824" returned: 0 in 0.604s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:31 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c Apr 13 09:49:31 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:32 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c" returned: 0 in 0.408s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdc53b0-8641-4384-a050-6717bda18a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab748502-4198-4007-9ef4-abcd341e966c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695cabc7-7b6b-4e98-a149-f20793630bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:32 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Volume volume-ab748502-4198-4007-9ef4-abcd341e966c (ab748502-4198-4007-9ef4-abcd341e966c): created successfully Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (695cabc7-7b6b-4e98-a149-f20793630bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Flow 'volume_create_manager' (8184b825-fa6f-4f43-b9a4-f7bbe9033190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:32 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-bce9dabe-00ac-450a-a118-98ac63bb2fe6 tempest-CreateVolumesFromImageTest-790055636 None] Created volume successfully. Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-ab748502-4198-4007-9ef4-abcd341e966c-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-ab748502-4198-4007-9ef4-abcd341e966c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-quobyte-ab748502-4198-4007-9ef4-abcd341e966c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-ab748502-4198-4007-9ef4-abcd341e966c" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[735ec346-5229-468f-a14b-7fec7297bca7]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:33 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c Apr 13 09:49:33 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:33 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c" returned: 0 in 0.457s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:33 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c Apr 13 09:49:33 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:34 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-ab748502-4198-4007-9ef4-abcd341e966c" returned: 0 in 0.391s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-ab748502-4198-4007-9ef4-abcd341e966c" released by "delete_volume" :: held 0.870s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Created reservations ['9aa3c764-4ccb-4bc5-816a-0bb1a2c417ec', 'b6cf9289-c122-4d91-820b-280b47a9572e', '119a973a-0dd2-4f91-9e24-4014598e52cf', '20318800-3eb5-4813-be01-8c084d312fb3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:34 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:34 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-0d3dc47e-7268-4ea7-b5d9-2db466143393-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-0d3dc47e-7268-4ea7-b5d9-2db466143393-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-quobyte-0d3dc47e-7268-4ea7-b5d9-2db466143393" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-0d3dc47e-7268-4ea7-b5d9-2db466143393" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3113b9-ff14-442b-b499-0c51e8b1ae92]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:34 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 Apr 13 09:49:34 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:34 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.429s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Deleted volume successfully. Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-e26e20f8-4cf2-4e72-a66d-37c1fccb4299 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-ab748502-4198-4007-9ef4-abcd341e966c-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:34 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393" returned: 0 in 0.508s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:34 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393 Apr 13 09:49:34 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:35 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0d3dc47e-7268-4ea7-b5d9-2db466143393" returned: 0 in 0.390s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-0d3dc47e-7268-4ea7-b5d9-2db466143393" released by "delete_volume" :: held 0.931s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=88,cinder:INSERT=13,cinder:UPDATE=113,cinder:DELETE=7 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Created reservations ['8db29b0d-f76b-40bd-8b55-b2c9950e32f3', '69ff1542-b68e-4342-9d20-a68cdce2989f', '9db7b397-1145-41d9-8456-c8b0a622a8ff', '6fdc0975-7440-497d-aed4-b9c85f5f43d0'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:35 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:35 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-edb08c5d-75d0-4c01-a64e-f492812c3c5c-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-edb08c5d-75d0-4c01-a64e-f492812c3c5c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-quobyte-edb08c5d-75d0-4c01-a64e-f492812c3c5c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-edb08c5d-75d0-4c01-a64e-f492812c3c5c" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[2439fdf8-f059-4c66-9f6a-7e382a1f6700]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:35 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c Apr 13 09:49:35 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:35 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.463s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:35 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Deleted volume successfully. Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-fd01f42c-89e6-47f7-bd54-30d6b75b0375 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-0d3dc47e-7268-4ea7-b5d9-2db466143393-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:35 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c" returned: 0 in 0.470s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:35 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c Apr 13 09:49:35 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:36 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-edb08c5d-75d0-4c01-a64e-f492812c3c5c" returned: 0 in 0.392s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-edb08c5d-75d0-4c01-a64e-f492812c3c5c" released by "delete_volume" :: held 0.888s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:UPDATE=96,cinder:SELECT=94,cinder:INSERT=37,cinder:DELETE=13 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Created reservations ['a12a777b-c770-42c6-ac26-79a58073dd03', '17ed5f2c-a255-41c7-8631-be8e578efe7b', '7b6f0971-8a2c-4b3c-a7d7-72767d694684', 'b691971d-6118-4e0c-a6ff-7ded44b8329c'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:36 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:36 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-d6c1796d-fe61-46df-aa9a-09f677856041-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-d6c1796d-fe61-46df-aa9a-09f677856041-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-quobyte-d6c1796d-fe61-46df-aa9a-09f677856041" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-d6c1796d-fe61-46df-aa9a-09f677856041" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730f593-5e02-4757-8e4c-27d1454e78cd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:36 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 Apr 13 09:49:36 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:36 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.416s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Deleted volume successfully. Apr 13 09:49:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-94dd5a2a-8e73-41e0-9164-a0b569649abf tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-edb08c5d-75d0-4c01-a64e-f492812c3c5c-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:37 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041" returned: 0 in 0.456s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:37 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041 Apr 13 09:49:37 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:37 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d6c1796d-fe61-46df-aa9a-09f677856041" returned: 0 in 0.398s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-d6c1796d-fe61-46df-aa9a-09f677856041" released by "delete_volume" :: held 0.877s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Created reservations ['1b2b7717-d66b-4f6e-b9ae-758ff70f35bf', '2c10f4a5-46aa-45b4-a746-85a6fef826aa', '0e1ca0a1-f7b3-4717-b954-9c6061e57359', 'b8411a9d-44ab-4c25-8f49-90af7fdcd554'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:37 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:37 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-02e10193-3df9-4e70-9090-8da580f088a3-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-02e10193-3df9-4e70-9090-8da580f088a3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "cinder-quobyte-02e10193-3df9-4e70-9090-8da580f088a3" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-02e10193-3df9-4e70-9090-8da580f088a3" acquired by "delete_volume" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9880eef5-d45b-464a-a494-851a952b5c2f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:37 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 Apr 13 09:49:37 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:37 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.413s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:37 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:38 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Deleted volume successfully. Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-73818d82-764b-4750-b06a-c641a404f4e7 tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-d6c1796d-fe61-46df-aa9a-09f677856041-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:38 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3" returned: 0 in 0.465s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:38 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3 Apr 13 09:49:38 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:38 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-02e10193-3df9-4e70-9090-8da580f088a3" returned: 0 in 0.389s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-quobyte-02e10193-3df9-4e70-9090-8da580f088a3" released by "delete_volume" :: held 0.873s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Created reservations ['e2ae42a1-b539-44ad-9b33-9c49948b8932', '1146e4ec-e97c-4aa1-9190-80881198924a', '6417f9ad-56d3-40ea-bdc5-18411dc22430', '9526c707-e70f-46f9-8b2a-74aa6ff8a153'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:38 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:38 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:39 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.445s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:39 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:39 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Deleted volume successfully. Apr 13 09:49:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-6076fb11-dfb3-4343-84da-e942401c288d tempest-CreateVolumesFromImageTest-790055636 None] Lock "cinder-02e10193-3df9-4e70-9090-8da580f088a3-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:45 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:45 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (cba170bb-e44f-41bd-a5a9-f07ac0e1de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9483e8a6-fcb0-4109-9ea5-16bab32a00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (e602f742-1364-46df-a07f-7c0d608eefe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc77fd1b-5f42-4d45-beac-4095b4ec2849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9483e8a6-fcb0-4109-9ea5-16bab32a00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679134021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7024767-6b58-4322-80d0-fd78da8fa4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093b8a29-7dcc-48e6-b935-907b3b619fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093b8a29-7dcc-48e6-b935-907b3b619fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942e846b-ca47-4b59-bc58-2ed1d32f0e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942e846b-ca47-4b59-bc58-2ed1d32f0e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7024767-6b58-4322-80d0-fd78da8fa4c5', 'volume_name': 'volume-c7024767-6b58-4322-80d0-fd78da8fa4c5', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0297ef0-3b91-4bf6-a5cd-f00e2148a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0297ef0-3b91-4bf6-a5cd-f00e2148a144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35fafe2-0342-4b4f-b0a4-55e94950b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume c7024767-6b58-4322-80d0-fd78da8fa4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7024767-6b58-4322-80d0-fd78da8fa4c5', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679134021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7024767-6b58-4322-80d0-fd78da8fa4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating volume c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc77fd1b-5f42-4d45-beac-4095b4ec2849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623240911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b89f781-4e9a-4f35-b2d9-bffe5135e275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2e35cf-c226-4224-aefd-f21a5a515c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2e35cf-c226-4224-aefd-f21a5a515c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9caed51b-8fe5-48d3-a81c-493e5d6b65ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9caed51b-8fe5-48d3-a81c-493e5d6b65ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b89f781-4e9a-4f35-b2d9-bffe5135e275', 'volume_name': 'volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0b3bf9-5151-4231-b7d4-67b23e497dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0b3bf9-5151-4231-b7d4-67b23e497dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7435511c-badc-4569-b624-e3d62dc5d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Volume 2b89f781-4e9a-4f35-b2d9-bffe5135e275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 1073741824 Apr 13 09:49:46 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (6b0c91dc-7a80-49dd-9edb-378e755f6b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb7f24f-d756-456c-aeb5-c8b129d28b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb7f24f-d756-456c-aeb5-c8b129d28b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-517809425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e779c6d7-0961-4e4e-b50f-9236b79e09cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c202a7dc204535b9d27ae8b328fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='a6bc15d800df4a43b769b84f6e9904cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef2cda-57ce-4b5d-bbd9-8f621026bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef2cda-57ce-4b5d-bbd9-8f621026bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c13b63-0668-4d1d-8b82-60d8cef597be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c13b63-0668-4d1d-8b82-60d8cef597be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e779c6d7-0961-4e4e-b50f-9236b79e09cb', 'volume_name': 'volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feef71aa-ab0d-474f-8d36-edc973154c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feef71aa-ab0d-474f-8d36-edc973154c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3247f0-55c6-4754-a684-416b3df70ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Volume e779c6d7-0961-4e4e-b50f-9236b79e09cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (b395ba4c-ef35-41c2-b277-03267e446c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62750c43-16da-4756-b773-3faf5002a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62750c43-16da-4756-b773-3faf5002a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61132057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82fd1b2-55c1-4dc9-9a4f-3b061de26d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7240d25-0f62-48cb-9596-13208b5c240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7240d25-0f62-48cb-9596-13208b5c240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a55563-8adf-4989-a6e6-0d48a80d70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a55563-8adf-4989-a6e6-0d48a80d70f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82fd1b2-55c1-4dc9-9a4f-3b061de26d88', 'volume_name': 'volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8a1c31-d9c8-4213-9558-4accfa16b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8a1c31-d9c8-4213-9558-4accfa16b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e0bf9c-6d12-4c86-87bf-30c28532154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume a82fd1b2-55c1-4dc9-9a4f-3b061de26d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (85b1b8e9-323e-4342-92e6-c668dfe364e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20c6cff-679d-4af6-8251-45cf8708e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20c6cff-679d-4af6-8251-45cf8708e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615388048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818a2fb5-b520-4e8e-9377-7fc27be8e273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b77c01f-1801-42a4-823d-3a0aad833d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b77c01f-1801-42a4-823d-3a0aad833d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d12ad4-c63f-492f-bcaa-5aafa6e33897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d12ad4-c63f-492f-bcaa-5aafa6e33897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818a2fb5-b520-4e8e-9377-7fc27be8e273', 'volume_name': 'volume-818a2fb5-b520-4e8e-9377-7fc27be8e273', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94655895-6b84-4860-a9d1-edbe8d1f4a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94655895-6b84-4860-a9d1-edbe8d1f4a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db787317-076c-4a4f-a0df-55746ebe2a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Volume 818a2fb5-b520-4e8e-9377-7fc27be8e273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818a2fb5-b520-4e8e-9377-7fc27be8e273', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (5010521f-6860-41cf-a9b8-9fd77f0b3c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568d6412-9809-4bc0-a0ed-ad0f48b707d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568d6412-9809-4bc0-a0ed-ad0f48b707d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1743594736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff77ae1-2a98-464e-8c24-5a5bb5b36072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:47Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511525b0-ee6a-4359-b709-fb604a46a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511525b0-ee6a-4359-b709-fb604a46a933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde08315-a0fa-4200-a71c-a49e51c4b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde08315-a0fa-4200-a71c-a49e51c4b50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff77ae1-2a98-464e-8c24-5a5bb5b36072', 'volume_name': 'volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b0e0b2-c5cd-42b2-89d9-2ac7b42469e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b0e0b2-c5cd-42b2-89d9-2ac7b42469e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c316db-1149-4e42-8b2c-7eab073c5234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Volume 5ff77ae1-2a98-464e-8c24-5a5bb5b36072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:46 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 1073741824" returned: 0 in 0.637s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:46 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 Apr 13 09:49:46 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (977c1a38-1735-4064-a1ca-bef123839174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdba57e-aef1-47df-ae74-8450b2c7cafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdba57e-aef1-47df-ae74-8450b2c7cafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066334084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f05361-9a38-4898-ac57-199a72b6a495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:47Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f8919d-a018-4497-8704-5a9703671f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f8919d-a018-4497-8704-5a9703671f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fd50da-242f-477d-833c-5e71f876a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fd50da-242f-477d-833c-5e71f876a62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f05361-9a38-4898-ac57-199a72b6a495', 'volume_name': 'volume-10f05361-9a38-4898-ac57-199a72b6a495', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6db7a45-1178-4c1d-bb01-9290a7bc0534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6db7a45-1178-4c1d-bb01-9290a7bc0534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ecea26-b822-406b-b8c1-960ace6ea6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:46 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Volume 10f05361-9a38-4898-ac57-199a72b6a495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f05361-9a38-4898-ac57-199a72b6a495', 'volume_size': 1} Apr 13 09:49:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (0ede941c-8c78-4086-ad48-8d5e04472994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a158150-dd9f-4773-b9c9-d9137464dd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a158150-dd9f-4773-b9c9-d9137464dd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566175788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3228c4-be40-45da-a777-a92f6441fab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:47Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48e9bc0-183d-4839-ad0d-759cacd5c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48e9bc0-183d-4839-ad0d-759cacd5c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501f606-4be8-4db1-aefb-97e8b86773ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501f606-4be8-4db1-aefb-97e8b86773ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3228c4-be40-45da-a777-a92f6441fab0', 'volume_name': 'volume-7e3228c4-be40-45da-a777-a92f6441fab0', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94170df9-425f-45a9-9ad1-896bbe4c2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94170df9-425f-45a9-9ad1-896bbe4c2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97343331-ddfe-4912-bd77-b60c609e72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:47 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Volume 7e3228c4-be40-45da-a777-a92f6441fab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3228c4-be40-45da-a777-a92f6441fab0', 'volume_size': 1} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:47 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5" returned: 0 in 0.452s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623240911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b89f781-4e9a-4f35-b2d9-bffe5135e275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Creating volume 2b89f781-4e9a-4f35-b2d9-bffe5135e275 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:47 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35fafe2-0342-4b4f-b0a4-55e94950b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7024767-6b58-4322-80d0-fd78da8fa4c5', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:47 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 1073741824 Apr 13 09:49:47 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3527f0e-d2d6-4534-a1a2-1e4b2ea7c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:47 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 (c7024767-6b58-4322-80d0-fd78da8fa4c5): created successfully Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3527f0e-d2d6-4534-a1a2-1e4b2ea7c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (cba170bb-e44f-41bd-a5a9-f07ac0e1de60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a5b5c63d-7454-4b02-b5cb-0f306909e314 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created volume successfully. Apr 13 09:49:47 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 1073741824" returned: 0 in 0.488s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:47 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 Apr 13 09:49:47 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:48 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275" returned: 0 in 0.406s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-517809425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e779c6d7-0961-4e4e-b50f-9236b79e09cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c202a7dc204535b9d27ae8b328fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='a6bc15d800df4a43b769b84f6e9904cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Creating volume e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:48 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7435511c-badc-4569-b624-e3d62dc5d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:48 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb 1073741824 Apr 13 09:49:48 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ed4b42-684d-4ad2-870f-dcc967c9bb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:48 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Volume volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 (2b89f781-4e9a-4f35-b2d9-bffe5135e275): created successfully Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ed4b42-684d-4ad2-870f-dcc967c9bb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (e602f742-1364-46df-a07f-7c0d608eefe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9fa3a582-ffb7-4000-a0c5-2699ef8b7876 tempest-CreateVolumesFromImageTest-1917159269 None] Created volume successfully. Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:48 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb 1073741824" returned: 0 in 0.515s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:48 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:49:48 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:49 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.428s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.704s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61132057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82fd1b2-55c1-4dc9-9a4f-3b061de26d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Creating volume a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:49 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3247f0-55c6-4754-a684-416b3df70ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028253f0-eaf7-4d63-869f-845264df0c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:49 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 1073741824 Apr 13 09:49:49 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:49 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Volume volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb (e779c6d7-0961-4e4e-b50f-9236b79e09cb): created successfully Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028253f0-eaf7-4d63-869f-845264df0c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (6b0c91dc-7a80-49dd-9edb-378e755f6b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:49 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1095c81d-58b9-4283-8876-9bc9ea5fbbdc tempest-VolumeDependencyTests-1939309539 None] Created volume successfully. Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:49 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 1073741824" returned: 0 in 0.549s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:49 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 Apr 13 09:49:49 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:50 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88" returned: 0 in 0.414s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.608s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615388048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818a2fb5-b520-4e8e-9377-7fc27be8e273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:46Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Creating volume 818a2fb5-b520-4e8e-9377-7fc27be8e273 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:50 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e0bf9c-6d12-4c86-87bf-30c28532154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5635428-6e0d-4d8f-b2e8-f91de19c8c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:50 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 1073741824 Apr 13 09:49:50 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:50 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 (a82fd1b2-55c1-4dc9-9a4f-3b061de26d88): created successfully Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5635428-6e0d-4d8f-b2e8-f91de19c8c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (b395ba4c-ef35-41c2-b277-03267e446c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a2d1f037-c4ee-4ccc-a9e0-9fd9324aa789 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created volume successfully. Apr 13 09:49:50 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 1073741824" returned: 0 in 0.551s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:50 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 Apr 13 09:49:50 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (a7d9f981-5e41-4e94-8774-157bab5c9150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8833912b-5a27-4154-b53b-2f22492df33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8833912b-5a27-4154-b53b-2f22492df33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164098834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae3f21e-8b2f-4052-b037-e675a19ae80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae3f21e-8b2f-4052-b037-e675a19ae80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f4879f-7999-4620-96f3-b38a513cdc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f4879f-7999-4620-96f3-b38a513cdc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6', 'volume_name': 'volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b4a1bf-958b-428e-87dc-0e0ab050ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b4a1bf-958b-428e-87dc-0e0ab050ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0022e00d-1580-44cd-9652-82d9cca63df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:50 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume 0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6', 'volume_size': 1} Apr 13 09:49:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (80efdc35-94bc-4349-b642-120925391af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6fcf07-ea49-4205-871d-bdf3c182b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6fcf07-ea49-4205-871d-bdf3c182b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2105372139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36851b91-3fa7-40a9-86ec-64a0fff32852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36851b91-3fa7-40a9-86ec-64a0fff32852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52597700-094b-45ec-808c-e13bdcc2156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52597700-094b-45ec-808c-e13bdcc2156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2', 'volume_name': 'volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcfed9e-8447-4f08-a643-6c50232d12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcfed9e-8447-4f08-a643-6c50232d12be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f706c39-23c3-4816-b74f-727a11c51cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume 92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2', 'volume_size': 1} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273" returned: 0 in 0.462s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.451s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1743594736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff77ae1-2a98-464e-8c24-5a5bb5b36072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:47Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Creating volume 5ff77ae1-2a98-464e-8c24-5a5bb5b36072 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db787317-076c-4a4f-a0df-55746ebe2a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818a2fb5-b520-4e8e-9377-7fc27be8e273', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edac7119-bf10-44ae-9152-82598e908fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 1073741824 Apr 13 09:49:51 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Volume volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 (818a2fb5-b520-4e8e-9377-7fc27be8e273): created successfully Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edac7119-bf10-44ae-9152-82598e908fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (85b1b8e9-323e-4342-92e6-c668dfe364e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0286c990-8dab-4a0e-b814-09485ab3900e tempest-CreateVolumesFromImageTest-1917159269 None] Created volume successfully. Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (da9f5db1-a353-439b-8a9b-3f4447e3149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52fa085-d131-4301-811d-1c06f4989831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52fa085-d131-4301-811d-1c06f4989831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1981011247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dc21d0-d850-45f4-a167-a49de8cd202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dc21d0-d850-45f4-a167-a49de8cd202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb1a5bd-1f95-4900-9a5b-a998ff03ea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb1a5bd-1f95-4900-9a5b-a998ff03ea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2', 'volume_name': 'volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5475edd-9144-4f8d-a265-b87078c24ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5475edd-9144-4f8d-a265-b87078c24ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c2490c-4654-4ec9-8d4a-f449cba4237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume 7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2', 'volume_size': 1} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (7d3d202f-aa5a-4663-b08c-e567c04f0f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373adb5a-8757-45ab-8da4-cfaae5dea52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373adb5a-8757-45ab-8da4-cfaae5dea52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679348792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d96a100-8247-42b3-9250-f46ca13aa89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3603cacb-a7a0-42d7-87f1-fb82fc37781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3603cacb-a7a0-42d7-87f1-fb82fc37781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d754799-0439-4c3e-b9fc-4dd3f991bb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d754799-0439-4c3e-b9fc-4dd3f991bb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d96a100-8247-42b3-9250-f46ca13aa89d', 'volume_name': 'volume-6d96a100-8247-42b3-9250-f46ca13aa89d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61077295-16cf-4459-b013-c11b2794e78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61077295-16cf-4459-b013-c11b2794e78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df7faef-7fc9-4c87-a81c-7e71c4d630b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume 6d96a100-8247-42b3-9250-f46ca13aa89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d96a100-8247-42b3-9250-f46ca13aa89d', 'volume_size': 1} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (1d2cf3ca-fd5b-494c-8c1f-d2886f9e1404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560fade1-4741-42a3-9b8c-0046dbaf7cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560fade1-4741-42a3-9b8c-0046dbaf7cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-109850793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8442e81e-f202-4258-9509-6855e4e5aa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:52Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002503cf-23fd-4598-bb43-25417eba6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002503cf-23fd-4598-bb43-25417eba6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43358153-5dfa-4acf-acb4-cda0f1b188a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43358153-5dfa-4acf-acb4-cda0f1b188a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8442e81e-f202-4258-9509-6855e4e5aa4f', 'volume_name': 'volume-8442e81e-f202-4258-9509-6855e4e5aa4f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a13ae0-ca7b-4f78-bb89-bd0cec81f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a13ae0-ca7b-4f78-bb89-bd0cec81f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4d5f41-cfc9-45ba-947b-367b9b449032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:51 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume 8442e81e-f202-4258-9509-6855e4e5aa4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8442e81e-f202-4258-9509-6855e4e5aa4f', 'volume_size': 1} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 1073741824" returned: 0 in 0.666s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:51 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 Apr 13 09:49:51 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:52 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072" returned: 0 in 0.472s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.413s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066334084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f05361-9a38-4898-ac57-199a72b6a495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:47Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Creating volume 10f05361-9a38-4898-ac57-199a72b6a495 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:52 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c316db-1149-4e42-8b2c-7eab073c5234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe08be8-beed-4343-9d5a-ccd996234b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:52 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 1073741824 Apr 13 09:49:52 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:52 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Volume volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 (5ff77ae1-2a98-464e-8c24-5a5bb5b36072): created successfully Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe08be8-beed-4343-9d5a-ccd996234b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (5010521f-6860-41cf-a9b8-9fd77f0b3c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:52 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d39ab391-8bc6-48e4-b719-cd4c82c87287 tempest-CreateVolumesFromImageTest-1917159269 None] Created volume successfully. Apr 13 09:49:52 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 1073741824" returned: 0 in 0.518s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:52 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:52 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 Apr 13 09:49:52 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:53 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495" returned: 0 in 0.389s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.131s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566175788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3228c4-be40-45da-a777-a92f6441fab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a51bdbc3944411a0fb34786e0bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:47Z,use_quota=True,user_id='d9cc7c1a0e6046239316a993263107ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Creating volume 7e3228c4-be40-45da-a777-a92f6441fab0 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:49:53 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:53 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 1073741824 Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ecea26-b822-406b-b8c1-960ace6ea6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f05361-9a38-4898-ac57-199a72b6a495', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:53 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5be7a57-4c5c-4228-a2c4-8caec29ea744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:53 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Volume volume-10f05361-9a38-4898-ac57-199a72b6a495 (10f05361-9a38-4898-ac57-199a72b6a495): created successfully Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5be7a57-4c5c-4228-a2c4-8caec29ea744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (977c1a38-1735-4064-a1ca-bef123839174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:53 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-844d90ea-b437-4480-a3f9-37063da5a50b tempest-CreateVolumesFromImageTest-1917159269 None] Created volume successfully. Apr 13 09:49:53 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 1073741824" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:53 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:53 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 Apr 13 09:49:53 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:54 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0" returned: 0 in 0.417s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.817s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97343331-ddfe-4912-bd77-b60c609e72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3228c4-be40-45da-a777-a92f6441fab0', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af118880-70ca-485c-b1c9-3fee6a444e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating offline snapshot 0053b5ea-f58c-4b92-b233-e41d893246e9 of volume c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:49:54 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Volume volume-7e3228c4-be40-45da-a777-a92f6441fab0 (7e3228c4-be40-45da-a777-a92f6441fab0): created successfully Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af118880-70ca-485c-b1c9-3fee6a444e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Flow 'volume_create_manager' (0ede941c-8c78-4086-ad48-8d5e04472994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f43be-81d8-44a5-a8da-7bf98fe52d50]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:54 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-007c88be-1b7c-4085-bff5-e34a79d0d576 tempest-CreateVolumesFromImageTest-1917159269 None] Created volume successfully. Apr 13 09:49:54 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 Apr 13 09:49:54 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-7e3228c4-be40-45da-a777-a92f6441fab0-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-7e3228c4-be40-45da-a777-a92f6441fab0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-quobyte-7e3228c4-be40-45da-a777-a92f6441fab0" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-7e3228c4-be40-45da-a777-a92f6441fab0" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d040b0-68fa-483f-aa2d-6ccfd4b67fac]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:54 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 Apr 13 09:49:54 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:54 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5" returned: 0 in 0.587s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:54 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:54 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 1G Apr 13 09:49:54 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:55 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0" returned: 0 in 0.484s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:55 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0 Apr 13 09:49:55 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:55 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 1G" returned: 0 in 0.503s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:55 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 Apr 13 09:49:55 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:55 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7e3228c4-be40-45da-a777-a92f6441fab0" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-7e3228c4-be40-45da-a777-a92f6441fab0" released by "delete_volume" :: held 0.951s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Created reservations ['650d66ad-a68f-41a3-88eb-40ed69472bfc', 'b4af3b98-a4e6-4bf3-ae38-2c2967e9e178', '87020be1-27f6-415e-b66d-502152b8920c', 'b0b74060-5ec4-4a5f-a5d2-bed775408b77'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:55 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:55 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-10f05361-9a38-4898-ac57-199a72b6a495-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-10f05361-9a38-4898-ac57-199a72b6a495-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-quobyte-10f05361-9a38-4898-ac57-199a72b6a495" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-10f05361-9a38-4898-ac57-199a72b6a495" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:55 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9" returned: 0 in 0.506s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:55 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 is being set with open permissions: ugo+rw Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f979ec0-c09f-4024-9740-39fd4cdc7707]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:55 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:55 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 Apr 13 09:49:55 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:55 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 Apr 13 09:49:55 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:56 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:56 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Deleted volume successfully. Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-41e7e92b-1666-48b4-a1b4-07c72f9d8684 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-7e3228c4-be40-45da-a777-a92f6441fab0-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:56 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9" returned: 0 in 0.409s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:56 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info Apr 13 09:49:56 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:56 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495" returned: 0 in 0.506s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:56 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495 Apr 13 09:49:56 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:56 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:56 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info is being set with open permissions: ugo+rw Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:56 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info Apr 13 09:49:56 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:56 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-10f05361-9a38-4898-ac57-199a72b6a495" returned: 0 in 0.429s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-10f05361-9a38-4898-ac57-199a72b6a495" released by "delete_volume" :: held 0.966s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Created reservations ['d952921e-52e0-4226-a775-2d06b87d141c', '0cabc1df-fb4e-4999-9709-812a616e65cf', '074f73af-ed22-448b-bec8-b4fa07da947a', 'f7e552b6-a610-4e72-b98f-04cc57dd3fe8'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:56 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:56 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-5ff77ae1-2a98-464e-8c24-5a5bb5b36072-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:56 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-5ff77ae1-2a98-464e-8c24-5a5bb5b36072-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-quobyte-5ff77ae1-2a98-464e-8c24-5a5bb5b36072" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-5ff77ae1-2a98-464e-8c24-5a5bb5b36072" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e64ea-bf3b-45d2-88bb-408462128234]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:57 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 Apr 13 09:49:57 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:57 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.info" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.634s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Creating offline snapshot e463b28b-eb22-400b-8fd1-57f210d1993c of volume e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030f56f-035b-4de6-84a8-e13c6c1feb99]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:57 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-691ee819-f3f5-42e7-aa48-d7701ae0f882 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Create snapshot completed successfully Apr 13 09:49:57 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:49:57 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:57 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:57 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Deleted volume successfully. Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9128b4b0-f755-4dbd-8fc2-58a28dd29498 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-10f05361-9a38-4898-ac57-199a72b6a495-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:57 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:57 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072 Apr 13 09:49:57 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:57 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.481s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:57 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c 1G Apr 13 09:49:57 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (07f679d1-d7ac-41c8-9500-a3361334ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e143f6-2fdf-409d-adc1-c6c6d17942e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e143f6-2fdf-409d-adc1-c6c6d17942e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260289498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edbc3c8-6578-4c90-b30b-79768bbb493f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:58Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:57 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde4ba50-3a54-4192-bb54-e67483730774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde4ba50-3a54-4192-bb54-e67483730774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27495ef9-907f-409f-85dd-ed71240efa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27495ef9-907f-409f-85dd-ed71240efa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edbc3c8-6578-4c90-b30b-79768bbb493f', 'volume_name': 'volume-2edbc3c8-6578-4c90-b30b-79768bbb493f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16bbdd1-238d-4dcd-96bc-32143a655374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16bbdd1-238d-4dcd-96bc-32143a655374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044f704f-8867-413b-9a33-99caf8d0bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume 2edbc3c8-6578-4c90-b30b-79768bbb493f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edbc3c8-6578-4c90-b30b-79768bbb493f', 'volume_size': 1} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5ff77ae1-2a98-464e-8c24-5a5bb5b36072" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-5ff77ae1-2a98-464e-8c24-5a5bb5b36072" released by "delete_volume" :: held 1.032s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Created reservations ['487c8648-c6c6-4e4c-8ba7-1db4e065cf53', 'b7da8321-1c29-407e-9ce9-abcd6d026c55', 'e89e7115-f575-4d2e-95d6-817e5dfd4556', '29e7e50c-0ffe-4081-b385-636775a62f32'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:58 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:49:58 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (e25e2ac2-8312-4a70-9831-46c8a6a88dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cf633d-5788-41f0-9a64-3bdfacc93f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cf633d-5788-41f0-9a64-3bdfacc93f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387442061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2304e32-2bb7-447e-a1fe-4de2e0754213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:58Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3f71de-c294-4b6e-8ffe-11561a72f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3f71de-c294-4b6e-8ffe-11561a72f34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e29d1f-2a30-4f57-9975-fdb1287ef63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e29d1f-2a30-4f57-9975-fdb1287ef63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2304e32-2bb7-447e-a1fe-4de2e0754213', 'volume_name': 'volume-d2304e32-2bb7-447e-a1fe-4de2e0754213', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4a82e5-bf1c-4e23-932a-a020ebe656c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4a82e5-bf1c-4e23-932a-a020ebe656c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16e3669-ba08-48cd-8074-4d09256ea799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume d2304e32-2bb7-447e-a1fe-4de2e0754213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2304e32-2bb7-447e-a1fe-4de2e0754213', 'volume_size': 1} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:58 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c 1G" returned: 0 in 0.603s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:58 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c Apr 13 09:49:58 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (745a87e1-0965-4462-913c-e04cf707e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbe2428-e497-4162-a3d6-d91558e64431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbe2428-e497-4162-a3d6-d91558e64431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133502691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca8523c-b95b-4bfe-9d1a-36838dd366ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:58Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ab6ffb-7bc5-4a94-bade-461d2473d6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ab6ffb-7bc5-4a94-bade-461d2473d6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a766bf4-ed05-4158-90c4-fe35b9ba4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a766bf4-ed05-4158-90c4-fe35b9ba4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca8523c-b95b-4bfe-9d1a-36838dd366ea', 'volume_name': 'volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71186568-7316-403b-be77-7500bbee3485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71186568-7316-403b-be77-7500bbee3485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3e76b9-b610-47ed-b5c8-0edae8f59d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume aca8523c-b95b-4bfe-9d1a-36838dd366ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea', 'volume_size': 1} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (3ebc8af1-3f0d-486a-954e-4932c58e2385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54aa249-d317-423e-a86f-7936dd639895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54aa249-d317-423e-a86f-7936dd639895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1350204908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2295be6d-5bab-4ce0-a824-cdf1ea704701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:59Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c0f2e0-894f-47a5-a6e3-a6d03aeea020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c0f2e0-894f-47a5-a6e3-a6d03aeea020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b7a379-e3bc-428a-9104-cefd064618ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b7a379-e3bc-428a-9104-cefd064618ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2295be6d-5bab-4ce0-a824-cdf1ea704701', 'volume_name': 'volume-2295be6d-5bab-4ce0-a824-cdf1ea704701', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dfddf3-9061-4971-bae5-d7305424da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dfddf3-9061-4971-bae5-d7305424da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5e552f-645e-4d95-ba76-66763362b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume 2295be6d-5bab-4ce0-a824-cdf1ea704701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2295be6d-5bab-4ce0-a824-cdf1ea704701', 'volume_size': 1} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:58 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.578s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:49:58 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Deleted volume successfully. Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-74fa8c72-9d7f-4045-884f-f94c706d8c42 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-5ff77ae1-2a98-464e-8c24-5a5bb5b36072-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (c9f7d3ef-88fe-48f2-a7c1-9eca650aff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2d9647-1b1b-42e8-84a6-a2b9e34a34c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c" returned: 0 in 0.582s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:58 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c is being set with open permissions: ugo+rw Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2d9647-1b1b-42e8-84a6-a2b9e34a34c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156748496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a018b070-134c-4f2a-a011-c2da607482eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:59Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c Apr 13 09:49:58 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e24448-f2d4-4b7b-8086-a7e1b8a1d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e24448-f2d4-4b7b-8086-a7e1b8a1d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa04d7c-6c86-4435-a735-7a2ce3d19470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa04d7c-6c86-4435-a735-7a2ce3d19470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a018b070-134c-4f2a-a011-c2da607482eb', 'volume_name': 'volume-a018b070-134c-4f2a-a011-c2da607482eb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9fca9c-e16d-4902-a29c-fbdc5cb9d01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9fca9c-e16d-4902-a29c-fbdc5cb9d01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acf7302-c696-4e63-a951-0c182d9977ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:49:58 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume a018b070-134c-4f2a-a011-c2da607482eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a018b070-134c-4f2a-a011-c2da607482eb', 'volume_size': 1} Apr 13 09:49:58 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-818a2fb5-b520-4e8e-9377-7fc27be8e273-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-818a2fb5-b520-4e8e-9377-7fc27be8e273-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-quobyte-818a2fb5-b520-4e8e-9377-7fc27be8e273" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-818a2fb5-b520-4e8e-9377-7fc27be8e273" acquired by "delete_volume" :: waited 0.022s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[344722c8-bc6b-49e3-8190-8c4a7f171c97]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:59 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 Apr 13 09:49:59 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:59 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c" returned: 0 in 0.418s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:59 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info Apr 13 09:49:59 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:59 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273" returned: 0 in 0.469s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:59 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273 Apr 13 09:49:59 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:49:59 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info" returned: 0 in 0.422s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:49:59 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info is being set with open permissions: ugo+rw Apr 13 09:49:59 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:49:59 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info Apr 13 09:49:59 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-818a2fb5-b520-4e8e-9377-7fc27be8e273" returned: 0 in 0.451s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-818a2fb5-b520-4e8e-9377-7fc27be8e273" released by "delete_volume" :: held 0.944s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Created reservations ['3a93c755-2ad3-423f-9f3c-c22122f2deb3', '574303d3-f58a-40f8-8be1-c3d48662e0e7', '94899841-8165-4909-bac4-3d80383ec407', '773eafed-f413-4934-b6bd-f1264bdbddd4'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:00 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.info" returned: 0 in 0.445s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.016s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:00 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:00 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.367s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164098834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Creating volume 0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:00 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:00 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 1073741824 Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-2b89f781-4e9a-4f35-b2d9-bffe5135e275-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:00 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d1867725-77b9-40ab-87a8-ac2eee499eee tempest-VolumeDependencyTests-1939309539 None] Create snapshot completed successfully Apr 13 09:50:00 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-2b89f781-4e9a-4f35-b2d9-bffe5135e275-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "cinder-quobyte-2b89f781-4e9a-4f35-b2d9-bffe5135e275" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-2b89f781-4e9a-4f35-b2d9-bffe5135e275" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[885bb006-5b8a-4a24-a1c4-ad2699f7e3f8]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:00 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 Apr 13 09:50:00 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:00 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:00 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.402s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:00 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Deleted volume successfully. Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-1c93087a-6c07-4b26-9a86-b86e1a6395c2 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-818a2fb5-b520-4e8e-9377-7fc27be8e273-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:00 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 1073741824" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:00 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 Apr 13 09:50:00 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275" returned: 0 in 0.510s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:00 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275 Apr 13 09:50:00 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:00 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.422s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:01 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6" returned: 0 in 0.497s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.152s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2105372139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Creating volume 92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:01 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:01 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 1073741824 Apr 13 09:50:01 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (ece64990-6955-4395-9540-e92b44371489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3385980d-e4a1-404e-9968-b4a2402ceb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:01 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0022e00d-1580-44cd-9652-82d9cca63df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1af53a-ba29-4d63-ae36-b8a4634d6737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2b89f781-4e9a-4f35-b2d9-bffe5135e275" returned: 0 in 0.498s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3385980d-e4a1-404e-9968-b4a2402ceb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1986445726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a418268b-053a-4507-ade0-dc608efd4eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c202a7dc204535b9d27ae8b328fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e463b28b-eb22-400b-8fd1-57f210d1993c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:01Z,use_quota=True,user_id='a6bc15d800df4a43b769b84f6e9904cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d85c8d0-79d7-4f36-833b-8199281b7c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d85c8d0-79d7-4f36-833b-8199281b7c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637038c4-7313-44ea-a856-62d40827df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637038c4-7313-44ea-a856-62d40827df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a418268b-053a-4507-ade0-dc608efd4eb7', 'volume_name': 'volume-a418268b-053a-4507-ade0-dc608efd4eb7', 'volume_size': 1, 'snapshot_id': 'e463b28b-eb22-400b-8fd1-57f210d1993c'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd16578d-2d9f-4b26-af58-f294c1f25e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd16578d-2d9f-4b26-af58-f294c1f25e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf195e64-0ffa-4870-a1aa-e2db9ceb6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:01 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Volume a418268b-053a-4507-ade0-dc608efd4eb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a418268b-053a-4507-ade0-dc608efd4eb7', 'volume_size': 1, 'snapshot_id': 'e463b28b-eb22-400b-8fd1-57f210d1993c'} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-quobyte-2b89f781-4e9a-4f35-b2d9-bffe5135e275" released by "delete_volume" :: held 1.079s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:01 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 (0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6): created successfully Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1af53a-ba29-4d63-ae36-b8a4634d6737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (a7d9f981-5e41-4e94-8774-157bab5c9150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a619f187-0859-495c-91a0-5ee8a948e2a6 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created volume successfully. Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Created reservations ['14af689c-127c-4d28-a0fc-d48aa819b196', 'e4b9089d-8478-43e4-a6dd-c4c924b26066', 'b104a47c-2365-4db7-9d9f-2ef9a73b56ec', 'bd488b07-8c6c-4e74-9a18-a1b5579a72a0'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:01 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:01 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:01 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 1073741824" returned: 0 in 0.477s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:01 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 Apr 13 09:50:01 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:01 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:01 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Deleted volume successfully. Apr 13 09:50:01 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-efae5bff-7d46-45af-9119-b954700d71e1 tempest-CreateVolumesFromImageTest-1917159269 None] Lock "cinder-2b89f781-4e9a-4f35-b2d9-bffe5135e275-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:02 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2" returned: 0 in 0.409s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.887s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1981011247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Creating volume 7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:02 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:02 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 1073741824 Apr 13 09:50:02 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f706c39-23c3-4816-b74f-727a11c51cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807b4497-cb41-425d-aa0d-8145e7fc19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:02 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 (92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2): created successfully Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807b4497-cb41-425d-aa0d-8145e7fc19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (80efdc35-94bc-4349-b642-120925391af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:02 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a1e88b21-66cb-49a3-86b2-3b51495d2e20 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created volume successfully. Apr 13 09:50:02 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 1073741824" returned: 0 in 0.560s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:02 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:02 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 Apr 13 09:50:02 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:03 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.709s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679348792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d96a100-8247-42b3-9250-f46ca13aa89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:51Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Creating volume 6d96a100-8247-42b3-9250-f46ca13aa89d {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:03 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:03 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d 1073741824 Apr 13 09:50:03 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c2490c-4654-4ec9-8d4a-f449cba4237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9cd0d4-6fe5-4323-96fa-ce296cce279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:03 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 (7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2): created successfully Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9cd0d4-6fe5-4323-96fa-ce296cce279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (da9f5db1-a353-439b-8a9b-3f4447e3149b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:03 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8144a3dd-2063-4392-85c7-f157316efc10 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created volume successfully. Apr 13 09:50:03 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d 1073741824" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:03 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:03 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d Apr 13 09:50:03 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:04 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d" returned: 0 in 0.459s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.485s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-109850793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8442e81e-f202-4258-9509-6855e4e5aa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4fa9e39f4d43b9adaaa8551846444c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:52Z,use_quota=True,user_id='98154b23398a49c6bbcf31732ded051f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Creating volume 8442e81e-f202-4258-9509-6855e4e5aa4f {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:04 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df7faef-7fc9-4c87-a81c-7e71c4d630b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d96a100-8247-42b3-9250-f46ca13aa89d', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb05d50-8c1a-46cc-aadb-e363c634b7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:04 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f 1073741824 Apr 13 09:50:04 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:04 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume volume-6d96a100-8247-42b3-9250-f46ca13aa89d (6d96a100-8247-42b3-9250-f46ca13aa89d): created successfully Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb05d50-8c1a-46cc-aadb-e363c634b7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (7d3d202f-aa5a-4663-b08c-e567c04f0f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:04 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f13efb86-6382-492e-bfb0-83be735a71f3 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created volume successfully. Apr 13 09:50:04 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f 1073741824" returned: 0 in 0.546s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:04 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:04 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f Apr 13 09:50:04 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:05 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f" returned: 0 in 0.490s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.339s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260289498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edbc3c8-6578-4c90-b30b-79768bbb493f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:58Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating volume 2edbc3c8-6578-4c90-b30b-79768bbb493f {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:05 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4d5f41-cfc9-45ba-947b-367b9b449032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8442e81e-f202-4258-9509-6855e4e5aa4f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb725a8-2621-42a5-9ccf-22aeecb94ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:05 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f 1073741824 Apr 13 09:50:05 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:05 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Volume volume-8442e81e-f202-4258-9509-6855e4e5aa4f (8442e81e-f202-4258-9509-6855e4e5aa4f): created successfully Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb725a8-2621-42a5-9ccf-22aeecb94ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Flow 'volume_create_manager' (1d2cf3ca-fd5b-494c-8c1f-d2886f9e1404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:05 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-688a25b8-cce2-42ab-bd8e-15b9ae4a3561 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created volume successfully. Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-8442e81e-f202-4258-9509-6855e4e5aa4f-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-8442e81e-f202-4258-9509-6855e4e5aa4f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-quobyte-8442e81e-f202-4258-9509-6855e4e5aa4f" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-8442e81e-f202-4258-9509-6855e4e5aa4f" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac2e53-fc72-4d93-9094-ddea05759016]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:05 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:05 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f Apr 13 09:50:05 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:06 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f 1073741824" returned: 0 in 0.645s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:06 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f Apr 13 09:50:06 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:06 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f" returned: 0 in 0.532s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:06 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f Apr 13 09:50:06 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:06 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f" returned: 0 in 0.537s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.294s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387442061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2304e32-2bb7-447e-a1fe-4de2e0754213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:58Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating volume d2304e32-2bb7-447e-a1fe-4de2e0754213 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:06 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044f704f-8867-413b-9a33-99caf8d0bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edbc3c8-6578-4c90-b30b-79768bbb493f', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a089ff80-29ce-41a5-beeb-e165047b5546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:06 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 1073741824 Apr 13 09:50:06 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:06 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume volume-2edbc3c8-6578-4c90-b30b-79768bbb493f (2edbc3c8-6578-4c90-b30b-79768bbb493f): created successfully Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a089ff80-29ce-41a5-beeb-e165047b5546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (07f679d1-d7ac-41c8-9500-a3361334ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:06 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-09f44efd-54de-4a73-9b36-98bac6286b6f tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created volume successfully. Apr 13 09:50:06 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-8442e81e-f202-4258-9509-6855e4e5aa4f" returned: 0 in 0.465s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-8442e81e-f202-4258-9509-6855e4e5aa4f" released by "delete_volume" :: held 1.054s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created reservations ['9be83964-5963-404a-96c8-03e4dea7fbb3', 'b444a5c2-43c5-48b3-9c30-da1b5c7f0b39', '00ccb332-5974-4722-ad5e-54333f76f66a', '9b99b8a0-5bb5-4c02-b74a-22f7b72a2d5c'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:06 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:06 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:06 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:07 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 1073741824" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:07 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 Apr 13 09:50:07 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:07 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Deleted volume successfully. Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-a525b7bf-719f-46d2-8847-bd742df75707 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-8442e81e-f202-4258-9509-6855e4e5aa4f-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:07 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213" returned: 0 in 0.476s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.172s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133502691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca8523c-b95b-4bfe-9d1a-36838dd366ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:58Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating volume aca8523c-b95b-4bfe-9d1a-36838dd366ea {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:07 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16e3669-ba08-48cd-8074-4d09256ea799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2304e32-2bb7-447e-a1fe-4de2e0754213', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c676138-2a60-4578-9f12-22775fcb5dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:07 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea 1073741824 Apr 13 09:50:07 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:07 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 (d2304e32-2bb7-447e-a1fe-4de2e0754213): created successfully Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c676138-2a60-4578-9f12-22775fcb5dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (e25e2ac2-8312-4a70-9831-46c8a6a88dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:07 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-1cdc39de-1f7f-432e-8a46-63fb1d8911f4 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created volume successfully. Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-6d96a100-8247-42b3-9250-f46ca13aa89d-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-6d96a100-8247-42b3-9250-f46ca13aa89d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-quobyte-6d96a100-8247-42b3-9250-f46ca13aa89d" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-6d96a100-8247-42b3-9250-f46ca13aa89d" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[5284d353-ddad-4dcf-a86f-2175ff083b7b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:07 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:07 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d Apr 13 09:50:07 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:08 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea 1073741824" returned: 0 in 0.656s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:08 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea Apr 13 09:50:08 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:08 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d" returned: 0 in 0.619s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:08 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d Apr 13 09:50:08 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:08 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea" returned: 0 in 0.434s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.118s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1350204908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2295be6d-5bab-4ce0-a824-cdf1ea704701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:59Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating volume 2295be6d-5bab-4ce0-a824-cdf1ea704701 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:08 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:08 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 1073741824 Apr 13 09:50:08 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3e76b9-b610-47ed-b5c8-0edae8f59d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e892de-83e5-40b0-82f6-518deb6f952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:08 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea (aca8523c-b95b-4bfe-9d1a-36838dd366ea): created successfully Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e892de-83e5-40b0-82f6-518deb6f952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:08 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (745a87e1-0965-4462-913c-e04cf707e47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:08 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0cd94cf1-86a0-49cf-8e07-39c0425fd13b tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created volume successfully. Apr 13 09:50:09 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-6d96a100-8247-42b3-9250-f46ca13aa89d" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-6d96a100-8247-42b3-9250-f46ca13aa89d" released by "delete_volume" :: held 1.142s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created reservations ['486a9ce0-470b-4973-8e87-bd294ccfe300', '4b9a602d-e246-45ce-96aa-41c58b1e588e', 'fce3d12a-a8a7-4566-bc68-e23932379bb5', '654aba61-e38b-4fe9-9fd2-1d0a18672aa9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:09 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:09 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:09 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 1073741824" returned: 0 in 0.648s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:09 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 Apr 13 09:50:09 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:09 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.460s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:09 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Deleted volume successfully. Apr 13 09:50:09 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9a4ffef3-96a6-4f5b-94da-2753f23cd323 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-6d96a100-8247-42b3-9250-f46ca13aa89d-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:10 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701" returned: 0 in 0.518s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.076s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-156748496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a018b070-134c-4f2a-a011-c2da607482eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba0a5880c884560bafc6e238e50efe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:49:59Z,use_quota=True,user_id='42e2056b2f2b4a6f9686d1c8be2860f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Creating volume a018b070-134c-4f2a-a011-c2da607482eb {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:10 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5e552f-645e-4d95-ba76-66763362b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2295be6d-5bab-4ce0-a824-cdf1ea704701', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:10 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb 1073741824 Apr 13 09:50:10 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74801c75-c68f-487f-be9d-698c503076d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:10 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 (2295be6d-5bab-4ce0-a824-cdf1ea704701): created successfully Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74801c75-c68f-487f-be9d-698c503076d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (3ebc8af1-3f0d-486a-954e-4932c58e2385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:10 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-2251516a-2601-4074-bafb-915d4e3c2e25 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created volume successfully. Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-quobyte-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[28210653-a4c1-4625-a6ff-713e45760c90]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:10 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 Apr 13 09:50:10 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:10 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb 1073741824" returned: 0 in 0.654s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:10 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb Apr 13 09:50:10 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:10 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2" returned: 0 in 0.615s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:10 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:10 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2 Apr 13 09:50:10 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:11 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb" returned: 0 in 0.495s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.805s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-e463b28b-eb22-400b-8fd1-57f210d1993c-a418268b-053a-4507-ade0-dc608efd4eb7" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acf7302-c696-4e63-a951-0c182d9977ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a018b070-134c-4f2a-a011-c2da607482eb', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a80bd9-e67a-4eac-830f-cff92e3ffb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e463b28b-eb22-400b-8fd1-57f210d1993c-a418268b-053a-4507-ade0-dc608efd4eb7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Creating volume a418268b-053a-4507-ade0-dc608efd4eb7 from snapshot e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-a418268b-053a-4507-ade0-dc608efd4eb7" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:11 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Volume volume-a018b070-134c-4f2a-a011-c2da607482eb (a018b070-134c-4f2a-a011-c2da607482eb): created successfully Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a80bd9-e67a-4eac-830f-cff92e3ffb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Flow 'volume_create_manager' (c9f7d3ef-88fe-48f2-a7c1-9eca650aff18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-a418268b-053a-4507-ade0-dc608efd4eb7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] snapshot: e463b28b-eb22-400b-8fd1-57f210d1993c, volume: a418268b-053a-4507-ade0-dc608efd4eb7, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:50:11 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-fd7a9c4e-8c76-4a1f-82dc-7e0776698268 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created volume successfully. Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:11 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2" returned: 0 in 0.487s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c1a846-3bec-4efa-b70f-6cab625e970e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2" released by "delete_volume" :: held 1.144s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created reservations ['5591ca20-feba-4215-9c43-8993d9375c30', 'a407abc8-e2fb-4770-8118-fde90e3e9c00', 'fa53a30d-b844-4ee4-8124-2849595e1604', '1d55922a-516c-4514-ae28-1385986686e3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:11 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c Apr 13 09:50:11 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:11 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:11 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-a018b070-134c-4f2a-a011-c2da607482eb-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-a018b070-134c-4f2a-a011-c2da607482eb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-a018b070-134c-4f2a-a011-c2da607482eb" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-a018b070-134c-4f2a-a011-c2da607482eb" acquired by "delete_volume" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d5effe-2483-455a-960e-2b7f2f435028]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:11 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:11 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Deleted volume successfully. Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-7c023c29-35d0-4327-a740-21564fde5dd5 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-7043b1d9-9d8e-4f65-8ebd-7ffdff0865e2-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:11 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb Apr 13 09:50:11 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:11 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c" returned: 0 in 0.662s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a229f3e-b3c8-45ca-a1e2-a76b824333d4]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:11 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:12 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:50:12 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-quobyte-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc41cd-6e17-4734-a1cd-8caaeac125ed]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:12 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 Apr 13 09:50:12 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:12 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb" returned: 0 in 0.644s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:12 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb Apr 13 09:50:12 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:12 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.556s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:12 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 Apr 13 09:50:12 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:12 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2" returned: 0 in 0.585s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:12 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:13 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a018b070-134c-4f2a-a011-c2da607482eb" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:13 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2 Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-a018b070-134c-4f2a-a011-c2da607482eb" released by "delete_volume" :: held 1.199s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:13 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['115be650-4a72-4a53-94a4-f53b5850017a', 'feb65876-b114-4f34-a299-8c8640661c07', '486967b4-dcec-4fa4-ae62-1766e259d8a1', 'b9cb98ac-71a4-4ceb-9e25-874da61c2ba9'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:13 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:13 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:13 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-2295be6d-5bab-4ce0-a824-cdf1ea704701-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-2295be6d-5bab-4ce0-a824-cdf1ea704701-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:14 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2" returned: 0 in 1.217s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2" released by "delete_volume" :: held 1.863s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-2295be6d-5bab-4ce0-a824-cdf1ea704701" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created reservations ['af7556bf-85e9-413b-8841-892f7646af1a', '726da763-3c01-4c31-a6e6-0680f4b4ead9', '671d4ec6-ec04-4790-83db-a0d8b8432083', 'a29198ac-89be-4e31-aa8b-4b82b563dbf7'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-2295be6d-5bab-4ce0-a824-cdf1ea704701" acquired by "delete_volume" :: waited 0.173s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[12abf141-7c63-4b55-a189-8eba2d0e0329]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:14 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:14 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:14 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 1.822s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:14 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:14 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 Apr 13 09:50:14 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:14 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleted volume successfully. Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-18637c22-a202-40ee-830d-fee5f7bb7513 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-a018b070-134c-4f2a-a011-c2da607482eb-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-quobyte-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:15 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7" returned: 0 in 2.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[15485482-cd08-4a7d-80c0-08d84d531ee2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67300c5-f398-4341-a6f8-8b038f8a435e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:15 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:50:15 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:15 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 Apr 13 09:50:15 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:15 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.897s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:15 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Deleted volume successfully. Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-48678697-f171-4a55-90fe-6431be4e52fd tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-92d38b8a-cbce-4a8d-acef-c3d4fcf2e5f2-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:15 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701" returned: 0 in 1.278s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:15 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701 Apr 13 09:50:15 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:15 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.732s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:50:15 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Converted 1024.00 MB image at 405.51 MB/s Apr 13 09:50:15 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 is being set with open permissions: ugo+rw Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:15 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 Apr 13 09:50:15 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:15 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6" returned: 0 in 0.809s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:15 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:15 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6 Apr 13 09:50:15 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:16 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2295be6d-5bab-4ce0-a824-cdf1ea704701" returned: 0 in 0.509s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-2295be6d-5bab-4ce0-a824-cdf1ea704701" released by "delete_volume" :: held 1.834s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['cc712ff1-52d3-4171-89e1-3186ff6a3163', 'ded0cdc0-b73e-4a6e-a650-3116757c0884', 'da0e33cd-051c-452a-bde3-bea058d11b4a', 'd7af2f38-1afa-4f33-a890-082d66a2bcbe'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:16 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7" returned: 0 in 0.605s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-a418268b-053a-4507-ade0-dc608efd4eb7" released by "_copy_volume_from_snapshot" :: held 5.153s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e463b28b-eb22-400b-8fd1-57f210d1993c-a418268b-053a-4507-ade0-dc608efd4eb7" released by "_create_volume_from_snapshot" :: held 5.182s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.202s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:16 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:16 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf195e64-0ffa-4870-a1aa-e2db9ceb6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a418268b-053a-4507-ade0-dc608efd4eb7', 'volume_size': 1, 'snapshot_id': 'e463b28b-eb22-400b-8fd1-57f210d1993c'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f0b692-e095-4e63-b3cf-ab7fe4d87d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-aca8523c-b95b-4bfe-9d1a-36838dd366ea-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:16 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Volume volume-a418268b-053a-4507-ade0-dc608efd4eb7 (a418268b-053a-4507-ade0-dc608efd4eb7): created successfully Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f0b692-e095-4e63-b3cf-ab7fe4d87d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (ece64990-6955-4395-9540-e92b44371489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-aca8523c-b95b-4bfe-9d1a-36838dd366ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:16 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8a44b047-34c4-439e-a787-8d01000b5377 tempest-VolumeDependencyTests-1939309539 None] Created volume successfully. Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-aca8523c-b95b-4bfe-9d1a-36838dd366ea" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-aca8523c-b95b-4bfe-9d1a-36838dd366ea" acquired by "delete_volume" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b563e3c4-18b7-4f1c-be5e-facd019c2e11]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:16 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6" returned: 0 in 0.675s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6" released by "delete_volume" :: held 1.526s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created reservations ['0174e85b-3c84-48bb-bf03-4ee44f625500', 'f6c3df2e-02d4-4968-ab31-6f7b4d7d98d5', '692a8567-1438-4277-8e99-2d9c20206cd3', 'eccb3a61-8de8-4472-9031-2514da25009b'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:16 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea Apr 13 09:50:16 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:16 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:16 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:16 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.546s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:16 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleted volume successfully. Apr 13 09:50:16 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-f7b454ee-f631-4ca4-87ed-57081e65a2ae tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-2295be6d-5bab-4ce0-a824-cdf1ea704701-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:17 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea" returned: 0 in 0.522s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:17 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea Apr 13 09:50:17 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:17 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.482s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:17 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Deleted volume successfully. Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0b9166f7-f6ad-441d-aafe-9f2507eb8c59 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-0e06fcd6-2733-4fc5-bb16-7c0b204ee3f6-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "cinder-quobyte-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88" acquired by "delete_volume" :: waited 0.019s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d07f0b-e175-46d2-8675-9c490c7356d5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:17 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 Apr 13 09:50:17 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-e463b28b-eb22-400b-8fd1-57f210d1993c-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-e463b28b-eb22-400b-8fd1-57f210d1993c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-e779c6d7-0961-4e4e-b50f-9236b79e09cb" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e779c6d7-0961-4e4e-b50f-9236b79e09cb" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-e463b28b-eb22-400b-8fd1-57f210d1993c" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e463b28b-eb22-400b-8fd1-57f210d1993c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Deleting offline snapshot e463b28b-eb22-400b-8fd1-57f210d1993c of volume e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] snapshot_file for this snap is: volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[da34a484-1006-4f83-a6d2-894249bf0da2]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:17 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c Apr 13 09:50:17 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:17 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-aca8523c-b95b-4bfe-9d1a-36838dd366ea" returned: 0 in 0.555s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-aca8523c-b95b-4bfe-9d1a-36838dd366ea" released by "delete_volume" :: held 1.112s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['4f500157-6c4a-4af4-9a53-f7ed00592264', '87089bba-8f96-423c-8147-498097996c4a', '03070000-1b5d-4a63-b265-2f7b37cf4bc5', '238d0727-1f38-46a3-b2e1-875cdc5201a3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:17 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:17 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:17 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88" returned: 0 in 0.587s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:17 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88 Apr 13 09:50:17 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:17 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c" returned: 0 in 0.513s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa65c9-1e6a-480f-b238-4653070e5d46]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:17 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:17 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:50:17 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:18 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.460s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleted volume successfully. Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d934b9d0-0408-4a79-950b-e56460e885f1 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-aca8523c-b95b-4bfe-9d1a-36838dd366ea-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:18 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88" returned: 0 in 0.452s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-quobyte-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88" released by "delete_volume" :: held 1.059s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Created reservations ['24c2d325-9138-4d26-8739-ea4f9d825b93', '94cffc0e-5815-45d4-b6d3-c07f69fa8469', 'e3d99219-5795-41d3-8b52-31897f5e7fc6', '759c920b-6aa3-48ef-a6a1-ae2fe00453e3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:18 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:18 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:18 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.619s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:18 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c Apr 13 09:50:18 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-d2304e32-2bb7-447e-a1fe-4de2e0754213-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-d2304e32-2bb7-447e-a1fe-4de2e0754213-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-d2304e32-2bb7-447e-a1fe-4de2e0754213" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-d2304e32-2bb7-447e-a1fe-4de2e0754213" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0692ffc-6aa3-4240-8237-3bfbb86ea74f]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:18 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 Apr 13 09:50:18 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:18 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.565s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:18 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Deleted volume successfully. Apr 13 09:50:18 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-dccc280f-41cb-4287-8a54-c77463dcba95 tempest-CreateVolumesFromSourceVolumeTest-1002303701 None] Lock "cinder-a82fd1b2-55c1-4dc9-9a4f-3b061de26d88-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:19 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c" returned: 0 in 0.590s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:19 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c Apr 13 09:50:19 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Flow 'volume_create_manager' (a09470db-c26f-4b3e-8181-d3269a20acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da883e1-5204-4077-a007-8d6750f4da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da883e1-5204-4077-a007-8d6750f4da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1254348402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc43fce4-299b-442e-949b-9c70339a72fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad1cd253ce442e8833caa512e621d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:19Z,use_quota=True,user_id='03541dd9936d486391507afa3bb0eeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da2aba9-074a-40c4-bb4c-b5b42554cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da2aba9-074a-40c4-bb4c-b5b42554cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b22ead-b246-4034-820e-aaff77abf50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b22ead-b246-4034-820e-aaff77abf50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc43fce4-299b-442e-949b-9c70339a72fe', 'volume_name': 'volume-cc43fce4-299b-442e-949b-9c70339a72fe', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a540ab9-1fda-4309-8333-ecc5fb1bf0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a540ab9-1fda-4309-8333-ecc5fb1bf0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1194a1-ed58-43d9-acd9-00d29301f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:19 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Volume cc43fce4-299b-442e-949b-9c70339a72fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc43fce4-299b-442e-949b-9c70339a72fe', 'volume_size': 1} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1254348402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc43fce4-299b-442e-949b-9c70339a72fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad1cd253ce442e8833caa512e621d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:19Z,use_quota=True,user_id='03541dd9936d486391507afa3bb0eeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Creating volume cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:19 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:19 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe 1073741824 Apr 13 09:50:19 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:19 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:19 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213 Apr 13 09:50:19 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:19 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb.e463b28b-eb22-400b-8fd1-57f210d1993c" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e463b28b-eb22-400b-8fd1-57f210d1993c" released by "_delete_snapshot" :: held 2.291s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e779c6d7-0961-4e4e-b50f-9236b79e09cb" released by "delete_snapshot" :: held 2.315s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Created reservations ['887e17f4-4c7d-437b-a4b0-3349f9f37143', '79d7c560-714d-403c-9807-f4d986bdce1e', '299b0fdd-5330-4bc7-88df-0d8c3c41cf28', '76402e67-540d-4821-8fd9-19a811d5c094'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:19 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Delete snapshot completed successfully. Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-ff423ca0-46e1-4514-aa8c-ec98681338fa tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-e463b28b-eb22-400b-8fd1-57f210d1993c-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:19 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe 1073741824" returned: 0 in 0.605s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:19 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-d2304e32-2bb7-447e-a1fe-4de2e0754213" returned: 0 in 0.561s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-d2304e32-2bb7-447e-a1fe-4de2e0754213" released by "delete_volume" :: held 1.139s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:19 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:19 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['3a37b872-69f7-424c-8ab2-b72c23cfcae4', '4975c085-5faf-48fa-ab60-f7d8215b72e3', '95b2fb1d-d180-4c04-bed5-cf2960f4075b', 'b881048c-5844-407c-87ee-5e0d747c5a98'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:19 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:19 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:19 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:20 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.453s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1194a1-ed58-43d9-acd9-00d29301f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc43fce4-299b-442e-949b-9c70339a72fe', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb226a5d-41c1-451b-813a-396df0217a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:20 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Volume volume-cc43fce4-299b-442e-949b-9c70339a72fe (cc43fce4-299b-442e-949b-9c70339a72fe): created successfully Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb226a5d-41c1-451b-813a-396df0217a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Flow 'volume_create_manager' (a09470db-c26f-4b3e-8181-d3269a20acd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:20 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-acd59d83-0f4c-4d57-99c8-7036f61a7bc3 tempest-SnapshotDependencyTests-2063491160 None] Created volume successfully. Apr 13 09:50:20 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:20 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleted volume successfully. Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-36b42a35-3523-4344-8475-8109d11651da tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-d2304e32-2bb7-447e-a1fe-4de2e0754213-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-e779c6d7-0961-4e4e-b50f-9236b79e09cb-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-e779c6d7-0961-4e4e-b50f-9236b79e09cb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-e779c6d7-0961-4e4e-b50f-9236b79e09cb" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e779c6d7-0961-4e4e-b50f-9236b79e09cb" acquired by "delete_volume" :: waited 0.012s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd655839-c4f5-429a-84c9-1981f0d42417]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:20 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:50:20 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-2edbc3c8-6578-4c90-b30b-79768bbb493f-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-2edbc3c8-6578-4c90-b30b-79768bbb493f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-2edbc3c8-6578-4c90-b30b-79768bbb493f" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-2edbc3c8-6578-4c90-b30b-79768bbb493f" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb18a7-057b-4421-90e5-fdf864fa197c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:20 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:20 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f Apr 13 09:50:20 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:21 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.571s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:21 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb Apr 13 09:50:21 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Flow 'volume_create_manager' (a0e01c77-1605-46ac-96af-556032feed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255ea74e-9dfe-49b9-a80b-32ed95030d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255ea74e-9dfe-49b9-a80b-32ed95030d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5c6385-f28b-46e2-94d7-c08fbe443bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a0cd7d97049c2b465973dbba1fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:21Z,use_quota=True,user_id='fbaf8b8e8b084e2aaf78d4da74fae047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ed5e03-71cd-493d-8f2d-8d78e7f6e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ed5e03-71cd-493d-8f2d-8d78e7f6e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34eb3995-3a5e-471c-ae55-057e0e004fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34eb3995-3a5e-471c-ae55-057e0e004fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5c6385-f28b-46e2-94d7-c08fbe443bf4', 'volume_name': 'volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db56872-c00a-459e-b4bd-674ff59af83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db56872-c00a-459e-b4bd-674ff59af83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca18813-607a-4e7c-a9bd-2af50771dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:21 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Volume 1b5c6385-f28b-46e2-94d7-c08fbe443bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4', 'volume_size': 1} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5c6385-f28b-46e2-94d7-c08fbe443bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a0cd7d97049c2b465973dbba1fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:21Z,use_quota=True,user_id='fbaf8b8e8b084e2aaf78d4da74fae047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Creating volume 1b5c6385-f28b-46e2-94d7-c08fbe443bf4 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:21 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:21 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 1073741824 Apr 13 09:50:21 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:21 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f" returned: 0 in 0.627s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:21 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f Apr 13 09:50:21 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:21 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-e779c6d7-0961-4e4e-b50f-9236b79e09cb" returned: 0 in 0.559s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-e779c6d7-0961-4e4e-b50f-9236b79e09cb" released by "delete_volume" :: held 1.163s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Created reservations ['e8718d5b-23b5-47fc-a926-30f9e1e133a7', '2fa91190-3559-4a27-b2c5-650756f3688b', 'e130739a-945f-40d7-a6a2-890dbedbbdea', 'ee64a9e9-8a0d-4e28-9e7a-69f944306bef'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:21 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:21 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:21 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 1073741824" returned: 0 in 0.589s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:21 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:22 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 Apr 13 09:50:22 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:22 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-2edbc3c8-6578-4c90-b30b-79768bbb493f" returned: 0 in 0.543s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-2edbc3c8-6578-4c90-b30b-79768bbb493f" released by "delete_volume" :: held 1.199s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['889d3ed6-0424-45f2-87b2-5dfd36f1c58a', '2dec8038-348a-4ed7-821e-aee5a67b4625', 'cad6ff7c-c96b-49d3-8a25-7cc04060fe61', '61540cc5-3e30-4363-97fa-5a73ef5192b3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:22 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:22 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:22 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.600s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Deleted volume successfully. Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-9c8fc429-639d-41ec-bc84-5143867173cc tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-e779c6d7-0961-4e4e-b50f-9236b79e09cb-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:22 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4" returned: 0 in 0.480s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.886s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca18813-607a-4e7c-a9bd-2af50771dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb3e2b0-14bd-47ea-80d2-a566b1477c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:22 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Volume volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 (1b5c6385-f28b-46e2-94d7-c08fbe443bf4): created successfully Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb3e2b0-14bd-47ea-80d2-a566b1477c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Flow 'volume_create_manager' (a0e01c77-1605-46ac-96af-556032feed91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b2bcb14a-6554-497b-92b1-1fd60e72e8a4 tempest-CinderUnicodeTest-71022063 None] Created volume successfully. Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Creating offline snapshot 655e6421-987d-4edd-945a-a191b1717efb of volume cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8139a00-3d3b-4c7a-ac6e-be85f0954753]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:22 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:22 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:22 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.493s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:22 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleted volume successfully. Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-31c8373c-e6eb-4022-93fe-563d503f798a tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-2edbc3c8-6578-4c90-b30b-79768bbb493f-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (46537506-195f-49e8-a5b3-f181b6c2598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aae988-4410-44b1-9ae0-b11181daf6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aae988-4410-44b1-9ae0-b11181daf6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-745840309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d73554e-52a7-4699-b6ac-bb4489a89445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c202a7dc204535b9d27ae8b328fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:23Z,use_quota=True,user_id='a6bc15d800df4a43b769b84f6e9904cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8882940-f4ba-4f43-b107-88a0342a3546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8882940-f4ba-4f43-b107-88a0342a3546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63162304-d573-49ab-827f-33e35251b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63162304-d573-49ab-827f-33e35251b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d73554e-52a7-4699-b6ac-bb4489a89445', 'volume_name': 'volume-5d73554e-52a7-4699-b6ac-bb4489a89445', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18031acc-f1cb-423c-9eb9-77e672eaff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18031acc-f1cb-423c-9eb9-77e672eaff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364a7a0e-0718-4b4d-8eba-52321684c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:22 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Volume 5d73554e-52a7-4699-b6ac-bb4489a89445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d73554e-52a7-4699-b6ac-bb4489a89445', 'volume_size': 1} Apr 13 09:50:22 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-0053b5ea-f58c-4b92-b233-e41d893246e9-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-0053b5ea-f58c-4b92-b233-e41d893246e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-c7024767-6b58-4322-80d0-fd78da8fa4c5" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-c7024767-6b58-4322-80d0-fd78da8fa4c5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-0053b5ea-f58c-4b92-b233-e41d893246e9" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-0053b5ea-f58c-4b92-b233-e41d893246e9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleting offline snapshot 0053b5ea-f58c-4b92-b233-e41d893246e9 of volume c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] snapshot_file for this snap is: volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[31200ab4-0249-48fd-892f-833af32333df]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:23 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.601s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:23 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb 1G Apr 13 09:50:23 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:23 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 Apr 13 09:50:23 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:23 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9" returned: 0 in 0.517s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7024767-6b58-4322-80d0-fd78da8fa4c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc513317-abd8-4f90-80f2-fc86888bb703]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Flow 'volume_create_manager' (f47df92f-9288-458d-ad4e-c89cf138898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82754b38-7f12-4d05-94aa-d8aadf3b7559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82754b38-7f12-4d05-94aa-d8aadf3b7559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-583003556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5c89be-f0e6-46d8-bba3-4d17af7c591c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a0cd7d97049c2b465973dbba1fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:24Z,use_quota=True,user_id='fbaf8b8e8b084e2aaf78d4da74fae047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423dcb6c-da3f-49b4-9617-715907f29a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:23 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 Apr 13 09:50:23 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:23 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423dcb6c-da3f-49b4-9617-715907f29a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e24125-48f9-438b-be31-3bc040cab3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e24125-48f9-438b-be31-3bc040cab3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5c89be-f0e6-46d8-bba3-4d17af7c591c', 'volume_name': 'volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba52a9f-47c6-4231-acee-282c532baccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba52a9f-47c6-4231-acee-282c532baccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b197ae2a-5cbb-4f2a-bc24-a37a9d29cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:23 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Volume 5d5c89be-f0e6-46d8-bba3-4d17af7c591c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c', 'volume_size': 1} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb 1G" returned: 0 in 0.635s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:23 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc43fce4-299b-442e-949b-9c70339a72fe -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:23 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc43fce4-299b-442e-949b-9c70339a72fe -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb Apr 13 09:50:23 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:24 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5" returned: 0 in 0.496s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:24 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 Apr 13 09:50:24 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:24 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc43fce4-299b-442e-949b-9c70339a72fe -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb" returned: 0 in 0.506s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:24 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb is being set with open permissions: ugo+rw Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:24 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb Apr 13 09:50:24 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:24 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9" returned: 0 in 0.539s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:24 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9 Apr 13 09:50:24 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:24 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb" returned: 0 in 0.433s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:24 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:24 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info Apr 13 09:50:24 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:25 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info" returned: 0 in 0.413s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:25 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info is being set with open permissions: ugo+rw Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:25 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info Apr 13 09:50:25 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:25 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5.0053b5ea-f58c-4b92-b233-e41d893246e9" returned: 0 in 0.500s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-0053b5ea-f58c-4b92-b233-e41d893246e9" released by "_delete_snapshot" :: held 2.135s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-c7024767-6b58-4322-80d0-fd78da8fa4c5" released by "delete_snapshot" :: held 2.147s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['5f257b99-966e-48c8-a88c-3f725e7ca080', '82512068-36df-4a57-99cf-b292ca4e3d26', '8060982f-7e05-4dcc-9c12-1b43e15720e1', '6dcd31a3-c3c0-4f5f-88d6-54c583cbea2a'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Delete snapshot completed successfully. Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-69c73c5f-a96e-4480-b216-7360ad49bfa8 tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-0053b5ea-f58c-4b92-b233-e41d893246e9-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:25 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.info" returned: 0 in 0.402s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.589s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-745840309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d73554e-52a7-4699-b6ac-bb4489a89445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c202a7dc204535b9d27ae8b328fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:23Z,use_quota=True,user_id='a6bc15d800df4a43b769b84f6e9904cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Creating volume 5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:25 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:25 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:25 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 1073741824 Apr 13 09:50:25 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:25 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-72117e9a-6a8b-4231-9f95-9ffab4d2424d tempest-SnapshotDependencyTests-2063491160 None] Create snapshot completed successfully Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Flow 'volume_create_manager' (4bbd665f-4144-4393-b38a-8bf6e6cb4922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc2bc40-0af8-4604-8dc0-48a7a817e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc2bc40-0af8-4604-8dc0-48a7a817e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c520ed5-25ba-46bf-ac6a-bef7dc6e2390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad1cd253ce442e8833caa512e621d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=655e6421-987d-4edd-945a-a191b1717efb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:26Z,use_quota=True,user_id='03541dd9936d486391507afa3bb0eeb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf22049-606b-40c8-81ab-c19a3ffe9fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf22049-606b-40c8-81ab-c19a3ffe9fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2817db0-1c8a-4188-b1a3-9c78d9c9c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2817db0-1c8a-4188-b1a3-9c78d9c9c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c520ed5-25ba-46bf-ac6a-bef7dc6e2390', 'volume_name': 'volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390', 'volume_size': 1, 'snapshot_id': '655e6421-987d-4edd-945a-a191b1717efb'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111952b7-b317-4a07-972e-f751b8f6e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111952b7-b317-4a07-972e-f751b8f6e788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e31b6e-3140-4ae3-b622-453d4ddf1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Volume 0c520ed5-25ba-46bf-ac6a-bef7dc6e2390: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390', 'volume_size': 1, 'snapshot_id': '655e6421-987d-4edd-945a-a191b1717efb'} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:26 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 1073741824" returned: 0 in 0.581s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-c7024767-6b58-4322-80d0-fd78da8fa4c5-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:26 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:26 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-c7024767-6b58-4322-80d0-fd78da8fa4c5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "cinder-quobyte-c7024767-6b58-4322-80d0-fd78da8fa4c5" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-c7024767-6b58-4322-80d0-fd78da8fa4c5" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c959891a-9943-4915-9973-c74df3eb7732]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:26 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 Apr 13 09:50:26 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:26 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.438s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.850s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-583003556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5c89be-f0e6-46d8-bba3-4d17af7c591c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4a0cd7d97049c2b465973dbba1fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:24Z,use_quota=True,user_id='fbaf8b8e8b084e2aaf78d4da74fae047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)}" {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Creating volume 5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:26 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] casted to osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c 1073741824 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:26 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c 1073741824 Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364a7a0e-0718-4b4d-8eba-52321684c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d73554e-52a7-4699-b6ac-bb4489a89445', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:26 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a391db72-38cb-4e4e-8a52-58722110e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:26 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Volume volume-5d73554e-52a7-4699-b6ac-bb4489a89445 (5d73554e-52a7-4699-b6ac-bb4489a89445): created successfully Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a391db72-38cb-4e4e-8a52-58722110e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (46537506-195f-49e8-a5b3-f181b6c2598e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:26 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-c9a1f772-da25-40e3-8196-b42502acb055 tempest-VolumeDependencyTests-1939309539 None] Created volume successfully. Apr 13 09:50:26 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5" returned: 0 in 0.476s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:26 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:26 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5 Apr 13 09:50:26 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:27 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c 1073741824" returned: 0 in 0.557s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:27 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c Apr 13 09:50:27 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:27 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-c7024767-6b58-4322-80d0-fd78da8fa4c5" returned: 0 in 0.598s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-quobyte-c7024767-6b58-4322-80d0-fd78da8fa4c5" released by "delete_volume" :: held 1.116s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Created reservations ['1cb927a1-cf35-4022-92cf-2a4efe990a41', 'dcae8235-8be6-44ea-9e32-addd4480935d', 'a89367e4-f9d0-42ee-9313-19525e907e39', 'ec25012f-8394-4e6e-a7a6-0747bf3e4706'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82295) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (bcee48c8-15cf-413e-bbef-123b87de4d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4f221c-17d4-41fc-b6e0-cd736e064a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4f221c-17d4-41fc-b6e0-cd736e064a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T07:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1397557999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e81e9d-3523-4402-8e5b-d375a0772b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c202a7dc204535b9d27ae8b328fb90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T07:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5d73554e-52a7-4699-b6ac-bb4489a89445,status='creating',terminated_at=None,updated_at=2026-04-13T07:50:27Z,use_quota=True,user_id='a6bc15d800df4a43b769b84f6e9904cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd1d084b-0db8-4037-aa03-f075333bfa87),volume_type_id=fd1d084b-0db8-4037-aa03-f075333bfa87)' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c828eda-5722-4c7b-9008-85264e29da60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c828eda-5722-4c7b-9008-85264e29da60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21749436-baa4-47c6-8b14-0c4d12ce7a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21749436-baa4-47c6-8b14-0c4d12ce7a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f5e81e9d-3523-4402-8e5b-d375a0772b4a', 'volume_name': 'volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a', 'volume_size': 1, 'source_volid': '5d73554e-52a7-4699-b6ac-bb4489a89445', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b0df8d-3f36-431d-956a-4afd69ff603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b0df8d-3f36-431d-956a-4afd69ff603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1897a70a-cbd3-4988-b5af-2a220e2af3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Volume f5e81e9d-3523-4402-8e5b-d375a0772b4a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a', 'volume_size': 1, 'source_volid': '5d73554e-52a7-4699-b6ac-bb4489a89445', 'source_volstatus': 'available'} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:27 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:27 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:27 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" returned: 0 in 0.458s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'} {{(pid=82295) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.526s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-quobyte-655e6421-987d-4edd-945a-a191b1717efb-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" by "_create_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b197ae2a-5cbb-4f2a-bc24-a37a9d29cada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c', 'volume_size': 1}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d02c6c-db85-43fe-925f-5c7daf63b87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-655e6421-987d-4edd-945a-a191b1717efb-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Creating volume 0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 from snapshot 655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Selected osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66 as target Quobyte volume. {{(pid=82295) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-quobyte-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:27 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Volume volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c (5d5c89be-f0e6-46d8-bba3-4d17af7c591c): created successfully Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d02c6c-db85-43fe-925f-5c7daf63b87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Flow 'volume_create_manager' (f47df92f-9288-458d-ad4e-c89cf138898c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] snapshot: 655e6421-987d-4edd-945a-a191b1717efb, volume: 0c520ed5-25ba-46bf-ac6a-bef7dc6e2390, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:50:27 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-241288ec-db10-42bc-a998-a0019728b7e6 tempest-CinderUnicodeTest-71022063 None] Created volume successfully. Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6627b9-3add-4ce4-a223-9ecf35680575]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:27 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:27 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb Apr 13 09:50:27 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:28 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.551s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:28 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Deleted volume successfully. Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-52f2b914-4b93-46a9-9ed1-f79490a15dfa tempest-CreateVolumesFromSnapshotTest-1405318898 None] Lock "cinder-c7024767-6b58-4322-80d0-fd78da8fa4c5-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:28 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb" returned: 0 in 0.669s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc43fce4-299b-442e-949b-9c70339a72fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[db329a9d-76aa-4c54-9517-8734c2a5ea20]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:28 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:28 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:28 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:28 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.583s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:29 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:50:29 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:29 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 Apr 13 09:50:29 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:31 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" returned: 0 in 2.269s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:31 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f524a6f-b41c-48b3-aa00-6d1c876a9559]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:31 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:31 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:31 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.591s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:31 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:50:31 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Converted 1024.00 MB image at 451.06 MB/s Apr 13 09:50:31 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 is being set with open permissions: ugo+rw Apr 13 09:50:31 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:31 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 Apr 13 09:50:31 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:32 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" returned: 0 in 0.398s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" released by "_copy_volume_from_snapshot" :: held 4.575s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-655e6421-987d-4edd-945a-a191b1717efb-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" released by "_create_volume_from_snapshot" :: held 4.601s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.620s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.747s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:32 devstack cinder-volume[82295]: INFO cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Cloning volume 5d73554e-52a7-4699-b6ac-bb4489a89445 to volume f5e81e9d-3523-4402-8e5b-d375a0772b4a Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e31b6e-3140-4ae3-b622-453d4ddf1df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390', 'volume_size': 1, 'snapshot_id': '655e6421-987d-4edd-945a-a191b1717efb'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd3c2da-ae8c-4a7f-85e5-a063e2a53db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Creating offline snapshot 1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 of volume 5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:50:32 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Volume volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 (0c520ed5-25ba-46bf-ac6a-bef7dc6e2390): created successfully Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd3c2da-ae8c-4a7f-85e5-a063e2a53db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Flow 'volume_create_manager' (4bbd665f-4144-4393-b38a-8bf6e6cb4922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7dd673-f472-40ec-b4ef-e06b12a719d0]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:32 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-b78836f9-c0ef-4eca-8988-0ab5156629b0 tempest-SnapshotDependencyTests-2063491160 None] Created volume successfully. Apr 13 09:50:32 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:32 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-655e6421-987d-4edd-945a-a191b1717efb-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-655e6421-987d-4edd-945a-a191b1717efb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-quobyte-cc43fce4-299b-442e-949b-9c70339a72fe" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-cc43fce4-299b-442e-949b-9c70339a72fe" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-quobyte-655e6421-987d-4edd-945a-a191b1717efb" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-655e6421-987d-4edd-945a-a191b1717efb" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Deleting offline snapshot 655e6421-987d-4edd-945a-a191b1717efb of volume cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] snapshot_file for this snap is: volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc3e97-6240-4a84-a2f5-d6f7cb97d512]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:32 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb Apr 13 09:50:32 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:32 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.515s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:32 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:32 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 1G Apr 13 09:50:32 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:33 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb" returned: 0 in 0.484s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc43fce4-299b-442e-949b-9c70339a72fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb4bbf4-81da-4f5e-a7b4-9e44784f95bb]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:33 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:33 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:33 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 1G" returned: 0 in 0.523s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d73554e-52a7-4699-b6ac-bb4489a89445 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:33 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d73554e-52a7-4699-b6ac-bb4489a89445 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 Apr 13 09:50:33 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:33 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.525s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:33 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb Apr 13 09:50:33 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:33 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d73554e-52a7-4699-b6ac-bb4489a89445 -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" returned: 0 in 0.431s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:33 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 is being set with open permissions: ugo+rw Apr 13 09:50:33 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:33 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 Apr 13 09:50:33 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:34 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb" returned: 0 in 0.447s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:34 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb Apr 13 09:50:34 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:34 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" returned: 0 in 0.425s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:34 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info Apr 13 09:50:34 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:34 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe.655e6421-987d-4edd-945a-a191b1717efb" returned: 0 in 0.456s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-655e6421-987d-4edd-945a-a191b1717efb" released by "_delete_snapshot" :: held 1.968s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-cc43fce4-299b-442e-949b-9c70339a72fe" released by "delete_snapshot" :: held 1.979s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Created reservations ['0297d7bd-b3c4-4b0f-922a-e095d409638c', '128769ca-087b-4fcb-a3b0-5c59a88409d7', '2de90655-6664-413e-8cb2-b03a43fb17e0', 'd9c80556-f63c-4553-bf9a-c53c14f487da'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:34 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Delete snapshot completed successfully. Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-388136e9-83e7-468f-95d5-587b82bae0c9 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-655e6421-987d-4edd-945a-a191b1717efb-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-cc43fce4-299b-442e-949b-9c70339a72fe-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-cc43fce4-299b-442e-949b-9c70339a72fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-quobyte-cc43fce4-299b-442e-949b-9c70339a72fe" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-cc43fce4-299b-442e-949b-9c70339a72fe" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8b858-3d64-4296-a95b-f5e9c43be662]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:34 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info" returned: 0 in 0.499s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:34 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info is being set with open permissions: ugo+rw Apr 13 09:50:34 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:34 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info Apr 13 09:50:34 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:34 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:34 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:35 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.info" returned: 0 in 0.450s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-f5e81e9d-3523-4402-8e5b-d375a0772b4a" by "_copy_volume_from_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-f5e81e9d-3523-4402-8e5b-d375a0772b4a" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] snapshot: 1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7, volume: f5e81e9d-3523-4402-8e5b-d375a0772b4a, {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:35 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.526s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[59044d47-1b46-481b-bed0-0af78d408583]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:35 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe Apr 13 09:50:35 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:35 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 Apr 13 09:50:35 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:35 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-cc43fce4-299b-442e-949b-9c70339a72fe" returned: 0 in 0.414s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-cc43fce4-299b-442e-949b-9c70339a72fe" released by "delete_volume" :: held 0.968s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:INSERT=53,cinder:UPDATE=286,cinder:SELECT=185,cinder:DELETE=29 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Created reservations ['f0aacaa9-d059-42e4-8b4a-a36bcd2a7f30', 'cd9d69e6-328a-431f-b0aa-97e201f79b51', '9a052b5f-aa3f-4dff-ad79-643795e8379f', '5625de32-f66b-4a1b-b2d5-7832f48e6c86'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:35 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d73554e-52a7-4699-b6ac-bb4489a89445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Creating direct copy from snapshot {{(pid=82295) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a830b6-82ea-41e6-9106-b46556f47263]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:35 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:35 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:35 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:35 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:35 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:36 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.404s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:36 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Deleted volume successfully. Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-14636ab6-2984-4ce8-b575-d62695209bde tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-cc43fce4-299b-442e-949b-9c70339a72fe-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:36 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.505s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG cinder.utils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Path /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a not found in is_blk_device check {{(pid=82295) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:36 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a Apr 13 09:50:36 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:UPDATE=255,cinder:SELECT=196,cinder:DELETE=19,cinder:INSERT=74 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:50:36 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "cinder-quobyte-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:37 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:37 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7bec21-1a0a-487d-89bb-7307c38a3d1e]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:37 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:37 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 Apr 13 09:50:37 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:38 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" returned: 0 in 1.108s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:38 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390 Apr 13 09:50:38 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:38 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a" returned: 0 in 2.018s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[54039853-365c-4d8f-bf72-86210acb9ccd]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:38 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:38 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:38 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" returned: 0 in 0.437s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-quobyte-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390" released by "delete_volume" :: held 1.584s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Created reservations ['e96d1c7e-3e77-451f-8138-74e913c5b656', '66c901cc-69b8-41b5-97a8-877275e63318', 'a30d4ea3-d727-4ce8-8348-8a34578de2be', '42c4214c-774a-421f-a32c-d78618cc1257'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:38 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:38 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:38 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.603s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG cinder.image.image_utils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Image conversion details: src /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a {{(pid=82295) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 09:50:38 devstack cinder-volume[82295]: INFO cinder.image.image_utils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Converted 1024.00 MB image at 507.02 MB/s Apr 13 09:50:38 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a is being set with open permissions: ugo+rw Apr 13 09:50:38 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:38 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a Apr 13 09:50:38 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:39 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.419s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:39 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Deleted volume successfully. Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-67bf1c66-ce6f-4054-b6ad-b3b3024f5615 tempest-SnapshotDependencyTests-2063491160 None] Lock "cinder-0c520ed5-25ba-46bf-ac6a-bef7dc6e2390-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:39 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a" returned: 0 in 0.445s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-f5e81e9d-3523-4402-8e5b-d375a0772b4a" released by "_copy_volume_from_snapshot" :: held 4.127s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Deleting offline snapshot 1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 of volume 5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] snapshot_file for this snap is: volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab7192-c2e0-42c2-b374-0e61b8c49994]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:39 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 Apr 13 09:50:39 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:39 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d73554e-52a7-4699-b6ac-bb4489a89445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6bad72-9670-4fe0-9539-5f3703c71e5c]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:39 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:40 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:40 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:40 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.560s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:40 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 Apr 13 09:50:40 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:40 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" returned: 0 in 0.501s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:40 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:41 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7 Apr 13 09:50:41 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:41 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445.1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" returned: 0 in 0.508s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-1bd952bf-b4f7-4371-bbe8-f8e18cc61ff7" released by "_delete_snapshot" :: held 2.138s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.251s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.431s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Creating offline snapshot c3d8bc56-5b18-41de-8d5c-3981b34d042d of volume 5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1897a70a-cbd3-4988-b5af-2a220e2af3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a', 'volume_size': 1, 'source_volid': '5d73554e-52a7-4699-b6ac-bb4489a89445', 'source_volstatus': 'available'}' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c693f2e-b694-4a7f-b969-d69b5b7f8f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e9fec7-7637-4011-b15f-3e21fc5ed22a]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:41 devstack cinder-volume[82295]: INFO cinder.volume.flows.manager.create_volume [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Volume volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a (f5e81e9d-3523-4402-8e5b-d375a0772b4a): created successfully Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c693f2e-b694-4a7f-b969-d69b5b7f8f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82295) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 09:50:41 devstack cinder-volume[82295]: DEBUG cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Flow 'volume_create_manager' (bcee48c8-15cf-413e-bbef-123b87de4d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82295) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 09:50:41 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-63d24413-826d-496b-ba93-cf7721365b34 tempest-VolumeDependencyTests-1939309539 None] Created volume successfully. Apr 13 09:50:41 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c Apr 13 09:50:41 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:42 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" returned: 0 in 0.573s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d 1G {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:42 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d 1G Apr 13 09:50:42 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-5d73554e-52a7-4699-b6ac-bb4489a89445-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-5d73554e-52a7-4699-b6ac-bb4489a89445-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-5d73554e-52a7-4699-b6ac-bb4489a89445" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-5d73554e-52a7-4699-b6ac-bb4489a89445" acquired by "delete_volume" :: waited 0.008s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e68748-80f2-4df7-935f-8ea96d91a9f5]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:42 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:42 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:42 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d 1G" returned: 0 in 0.560s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:42 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:42 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d Apr 13 09:50:42 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:43 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.585s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:43 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445 Apr 13 09:50:43 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:43 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c -F qcow2 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d" returned: 0 in 0.503s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:43 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d is being set with open permissions: ugo+rw Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:43 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d Apr 13 09:50:43 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:43 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d73554e-52a7-4699-b6ac-bb4489a89445" returned: 0 in 0.533s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-5d73554e-52a7-4699-b6ac-bb4489a89445" released by "delete_volume" :: held 1.162s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Created reservations ['1250cb08-7b89-4f27-b73e-2040bd838058', 'e5fb8a83-db61-4dc2-b612-32efa71417d3', 'b5e75232-2c43-4fb7-9db5-ffbd628f916e', '57b4cd59-2359-49d6-8a9b-d034c7012fbd'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:43 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d" returned: 0 in 0.482s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:43 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:43 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:43 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:43 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:43 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:44 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info" returned: 0 in 0.507s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:44 devstack cinder-volume[82295]: WARNING cinder.volume.drivers.remotefs [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info is being set with open permissions: ugo+rw Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:44 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info Apr 13 09:50:44 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:44 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.524s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:44 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Deleted volume successfully. Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-cd787fa8-cd77-4a0b-ac0b-4dcec572848b tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-5d73554e-52a7-4699-b6ac-bb4489a89445-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-f5e81e9d-3523-4402-8e5b-d375a0772b4a-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-f5e81e9d-3523-4402-8e5b-d375a0772b4a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-f5e81e9d-3523-4402-8e5b-d375a0772b4a" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-f5e81e9d-3523-4402-8e5b-d375a0772b4a" acquired by "delete_volume" :: waited 0.007s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b94225-c1ec-4b32-a180-1a43d1856e62]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:44 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.info" returned: 0 in 0.479s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:44 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.183s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:44 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-470f3872-afa9-4c10-ad0f-d06e883f3b04 tempest-CinderUnicodeTest-71022063 None] Create snapshot completed successfully Apr 13 09:50:44 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a Apr 13 09:50:44 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:45 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a" returned: 0 in 0.564s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:45 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a Apr 13 09:50:45 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:45 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-f5e81e9d-3523-4402-8e5b-d375a0772b4a" returned: 0 in 0.416s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-f5e81e9d-3523-4402-8e5b-d375a0772b4a" released by "delete_volume" :: held 1.019s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Created reservations ['d33d36f5-fe23-4c08-b5c6-6d7d7296d596', 'b3760ba2-6cad-4cd7-b346-97dc9108c887', '724bff39-bd79-40c7-9f02-83839f8b742b', '18607166-6ee1-4e55-9b4d-827f3c079bf7'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-c3d8bc56-5b18-41de-8d5c-3981b34d042d-delete_snapshot" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:45 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:45 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Lock "cinder-c3d8bc56-5b18-41de-8d5c-3981b34d042d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-quobyte-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" by "delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-quobyte-c3d8bc56-5b18-41de-8d5c-3981b34d042d" by "_delete_snapshot" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-c3d8bc56-5b18-41de-8d5c-3981b34d042d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Deleting offline snapshot c3d8bc56-5b18-41de-8d5c-3981b34d042d of volume 5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] snapshot_file for this snap is: volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d {{(pid=82295) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bab881d-37f1-4bc3-891a-a9bc4934ff2b]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:45 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:45 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d Apr 13 09:50:45 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:46 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:46 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Deleted volume successfully. Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-553e6ed7-eb47-44b8-ad8c-6e79ad15d145 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-f5e81e9d-3523-4402-8e5b-d375a0772b4a-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:46 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d" returned: 0 in 0.567s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.remotefs [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82295) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924f8e7-6219-4f80-bfff-37cb7089da58]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:46 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c Apr 13 09:50:46 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-a418268b-053a-4507-ade0-dc608efd4eb7-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-a418268b-053a-4507-ade0-dc608efd4eb7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:46 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" returned: 0 in 0.465s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:46 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d Apr 13 09:50:46 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "cinder-quobyte-a418268b-053a-4507-ade0-dc608efd4eb7" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-a418268b-053a-4507-ade0-dc608efd4eb7" acquired by "delete_volume" :: waited 0.014s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedd347-8c5e-4492-b1ac-a5334f778933]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:46 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:47 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 Apr 13 09:50:47 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:47 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d" returned: 0 in 0.461s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:47 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d Apr 13 09:50:47 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:47 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7" returned: 0 in 0.473s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:47 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7 Apr 13 09:50:47 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:47 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c.c3d8bc56-5b18-41de-8d5c-3981b34d042d" returned: 0 in 0.403s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-c3d8bc56-5b18-41de-8d5c-3981b34d042d" released by "_delete_snapshot" :: held 1.959s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" released by "delete_snapshot" :: held 1.975s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Created reservations ['dc396ca5-ea2c-4905-a15d-87ba7e5263da', 'ed5b278c-36a6-4cb9-b4b3-198207de57fe', '5a1b7ae9-ece3-4b3b-97ef-06b455db58ab', '67c3bd98-58c4-4da4-a3b6-b9105eaf2cd3'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:47 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-a418268b-053a-4507-ade0-dc608efd4eb7" returned: 0 in 0.426s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-quobyte-a418268b-053a-4507-ade0-dc608efd4eb7" released by "delete_volume" :: held 0.925s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:47 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Delete snapshot completed successfully. Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-0ab685c1-ef2f-4091-95a1-14cbbbeef81f tempest-CinderUnicodeTest-71022063 None] Lock "cinder-c3d8bc56-5b18-41de-8d5c-3981b34d042d-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Created reservations ['162e22e0-34de-4933-a180-800125ff916c', 'f40ddfa0-1872-45f5-b1c9-7e2ada898c97', '2316b926-6170-4a58-a2fa-f3f17444896a', 'cbc63281-cd2a-4fc0-87d9-4fde4820a0cd'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:47 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:48 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:48 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:48 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:48 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.439s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:48 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:48 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Deleted volume successfully. Apr 13 09:50:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-d04dbd90-1617-4399-99ec-0bfcd1dd57f8 tempest-VolumeDependencyTests-1939309539 None] Lock "cinder-a418268b-053a-4507-ade0-dc608efd4eb7-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:48 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-5d5c89be-f0e6-46d8-bba3-4d17af7c591c-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Lock "cinder-5d5c89be-f0e6-46d8-bba3-4d17af7c591c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-quobyte-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" acquired by "delete_volume" :: waited 0.009s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[002f9670-c8bb-4364-acd6-626f7ae93686]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:49 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c Apr 13 09:50:49 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:49 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" returned: 0 in 0.489s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:49 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c Apr 13 09:50:49 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:49 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" returned: 0 in 0.414s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:49 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-5d5c89be-f0e6-46d8-bba3-4d17af7c591c" released by "delete_volume" :: held 0.949s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Created reservations ['8a919099-2258-4bbf-9508-9d706c800d76', '14ea8187-ad93-4c7b-851c-0ef05208d3b2', '0af6119e-009d-4904-87b5-066b1e110c19', 'b5da9469-e3a5-4d55-a3af-2797cdcf34a8'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:50 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:50 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-1b5c6385-f28b-46e2-94d7-c08fbe443bf4-delete_volume" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Lock "cinder-1b5c6385-f28b-46e2-94d7-c08fbe443bf4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "cinder-quobyte-1b5c6385-f28b-46e2-94d7-c08fbe443bf4" by "delete_volume" {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-1b5c6385-f28b-46e2-94d7-c08fbe443bf4" acquired by "delete_volume" :: waited 0.011s {{(pid=82295) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d3d2e6-851c-42b0-af77-0eaac3a22c01]: (4, 'qcow2') {{(pid=83336) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:50 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 Apr 13 09:50:50 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:50 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.423s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:50 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Deleted volume successfully. Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-8c677120-22c8-4df6-b2af-f1dff0cb12cd tempest-CinderUnicodeTest-71022063 None] Lock "cinder-5d5c89be-f0e6-46d8-bba3-4d17af7c591c-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:50 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4" returned: 0 in 0.519s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:50 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:50 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4 Apr 13 09:50:50 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:51 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983/volume-1b5c6385-f28b-46e2-94d7-c08fbe443bf4" returned: 0 in 0.418s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Lock "cinder-quobyte-1b5c6385-f28b-46e2-94d7-c08fbe443bf4" released by "delete_volume" :: held 0.960s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG cinder.quota [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Created reservations ['d9d97603-3eb0-4931-b653-73cb19415bef', '3bdcbf6b-a0e2-438b-952a-4cf4aadb6f83', 'a3d6f143-b454-4af3-ba46-5352766a0fc5', '81c28759-34db-43c8-9188-8f75eee9ba16'] {{(pid=82295) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:50:51 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:50:51 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:50:51 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.466s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:50:51 devstack cinder-volume[82295]: INFO cinder.volume.manager [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Deleted volume successfully. Apr 13 09:50:51 devstack cinder-volume[82295]: DEBUG cinder.coordination [None req-736cc281-60f0-42c6-bf8c-5c0b73e2fb86 tempest-CinderUnicodeTest-71022063 None] Lock "cinder-1b5c6385-f28b-46e2-94d7-c08fbe443bf4-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82295) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG oslo_service.periodic_task [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82295) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66': None} {{(pid=82295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG cinder.volume.drivers.quobyte [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-baeca8fa-dd0e-40b6-b8a8-1811087b6b66'] {{(pid=82295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.lockutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82295) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 09:51:00 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983 Apr 13 09:51:00 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 09:51:00 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG oslo_concurrency.processutils [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3584d207d2ed8b827bb2c8b55d6e8983" returned: 0 in 0.425s {{(pid=82295) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 09:51:00 devstack cinder-volume[82295]: DEBUG cinder.manager [None req-443c2ad6-a0d0-41f0-a991-dec8126bd873 None None] Notifying Schedulers of capabilities ... {{(pid=82295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 09:51:01 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=43,cinder:INSERT=15,cinder:UPDATE=69,cinder:DELETE=2 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 09:51:01 devstack cinder-volume[82295]: DEBUG dbcounter [-] [82295] Writing DB stats cinder:SELECT=37,cinder:INSERT=17,cinder:UPDATE=55,cinder:DELETE=7 {{(pid=82295) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}